-- Logs begin at Mon 2022-05-09 22:11:50 UTC, end at Mon 2022-05-09 23:27:49 UTC. -- May 09 22:53:25.116470 dv-cinder-840678-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 09 22:53:25.126214 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 09 22:53:25.127758 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 22:53:25 2022] *** May 09 22:53:25.127758 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 22:53:25.127758 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 22:53:25.127758 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: nodename: dv-cinder-840678-5-iscsi May 09 22:53:25.127758 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: machine: x86_64 May 09 22:53:25.127758 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: clock source: unix May 09 22:53:25.127758 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: pcre jit disabled May 09 22:53:25.127758 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: detected number of CPU cores: 4 May 09 22:53:25.127758 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: current working directory: / May 09 22:53:25.127758 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: detected binary path: /usr/bin/uwsgi-core May 09 22:53:25.128464 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: your processes number limit is 47680 May 09 22:53:25.128464 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: your memory page size is 4096 bytes May 09 22:53:25.128464 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: detected max file descriptor number: 2048 May 09 22:53:25.128464 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: lock engine: pthread robust mutexes May 09 22:53:25.128464 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: thunder lock: enabled May 09 22:53:25.128464 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 09 22:53:25.128464 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 22:53:25.173868 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: Python main interpreter initialized at 0x55bd371c09c0 May 09 22:53:25.173868 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: python threads support enabled May 09 22:53:25.173868 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: your server socket listen backlog is limited to 100 connections May 09 22:53:25.173868 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: your mercy for graceful operations on workers is 90 seconds May 09 22:53:25.174249 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: mapped 403077 bytes (393 KB) for 2 cores May 09 22:53:25.174330 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: *** Operational MODE: preforking *** May 09 22:53:25.174561 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: *** uWSGI is running in multiple interpreter mode *** May 09 22:53:25.174561 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: spawned uWSGI master process (pid: 102608) May 09 22:53:25.174771 dv-cinder-840678-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 09 22:53:25.175969 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: spawned uWSGI worker 1 (pid: 102609, cores: 1) May 09 22:53:25.175969 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: spawned uWSGI worker 2 (pid: 102610, cores: 1) May 09 22:53:25.175969 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 22:53:26.359350 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 22:53:26.379318 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 22:53:27.087468 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 22:53:27.087468 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: from cryptography.utils import int_from_bytes May 09 22:53:27.087800 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 22:53:27.087800 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: from cryptography.utils import int_from_bytes May 09 22:53:27.089384 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 22:53:27.089384 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: from cryptography.utils import int_from_bytes May 09 22:53:27.089711 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 22:53:27.089711 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: from cryptography.utils import int_from_bytes May 09 22:53:29.673675 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 22:53:29.674178 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 22:53:29.674480 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 22:53:29.674777 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 22:53:29.675152 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 22:53:29.675240 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 22:53:29.675331 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 22:53:29.675466 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.675563 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 22:53:29.675794 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.675911 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 22:53:29.676118 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.676205 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 22:53:29.676439 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.676550 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.676771 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.676881 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.677087 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.677253 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.677412 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.677499 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.677735 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.677821 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.678064 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.678218 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.678357 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.678552 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.678676 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.678878 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.679006 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-5-iscsi {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.679213 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.679330 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.679480 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.679641 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.679801 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.679954 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.680133 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-5-iscsi {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.680274 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.680460 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.680582 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.680775 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.680910 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.681086 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.681219 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.681411 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.681716 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.682138 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.682138 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.682393 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.682503 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.682608 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.682774 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.682898 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.683116 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.683245 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.683436 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.683531 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.683752 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.683896 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.684124 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.684755 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.684941 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.685133 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.685300 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.685569 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.685663 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.685969 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-5-iscsi {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.686150 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.686315 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.686411 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.686631 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.686721 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.686949 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.687057 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.687363 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.687526 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-5-iscsi {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.687680 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.687819 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.687995 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.688100 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.688324 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.688411 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.688650 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.688738 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.688961 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.689055 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.689290 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.689385 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.689610 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.689700 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.689934 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.690033 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.690284 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.690375 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.690592 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.690680 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.690906 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.691020 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.691216 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.691304 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.691537 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.691624 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.691845 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.691940 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.692151 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.692244 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.692405 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.692492 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.692715 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.692812 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.693039 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.693126 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.693361 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.693447 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.693619 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.693721 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.693925 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.694030 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.694198 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.694289 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.694524 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.694614 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.694847 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.694953 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.695141 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.695240 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.695397 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.695484 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.695720 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.695816 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.696046 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.696149 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.696353 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.696439 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.696663 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.696749 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.696969 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.697065 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.697278 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.697378 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.697585 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.697671 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.697896 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.697985 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.698233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.698343 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.698545 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.698633 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.698866 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.698952 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.699183 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.699276 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.699505 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.699591 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.700343 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.700436 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.700672 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.700766 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.700994 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.701102 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.701310 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.701442 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.701619 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.701801 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.701963 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.702314 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.702622 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.702947 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.703196 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.703283 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.703573 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.703884 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.704204 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.704528 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.704855 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.704990 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.705169 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.705354 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.705435 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.705699 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.705839 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.706137 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.706484 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.706843 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.707143 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.707377 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.707603 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.707819 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.708028 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.708264 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.708264 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.708650 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.708854 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.709084 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.709317 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.709547 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.709547 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.709975 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.710250 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.710479 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.710706 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.710936 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.711235 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.711464 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.711690 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.711910 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.712145 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.712371 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.712532 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.712670 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.712815 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.712951 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.713095 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.713231 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.713231 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.713496 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.713639 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.713783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.713924 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.713924 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.714346 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.714482 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.714482 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.714738 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.714959 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.714959 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.715217 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.715400 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.715491 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.715596 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.716183 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.716274 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.716355 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.716444 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.716531 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.716620 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.716724 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.716819 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.716901 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.716980 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.717063 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.717152 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.717351 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.717439 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.717664 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.717751 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.718003 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.718176 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.718312 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.718450 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.718624 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.718929 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.719062 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.719240 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.719514 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.719652 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.719863 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.720100 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.720239 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.720471 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.720695 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.720833 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.721079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.721280 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.721424 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.721682 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.721772 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.721997 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.722216 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.722351 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.722499 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.722635 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.722769 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.722951 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.723085 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.723266 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.723415 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.723643 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.723965 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.724288 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.724434 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.724618 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.724761 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.724965 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.725111 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 22:53:29.725310 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.725456 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.725664 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.725754 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.725987 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.726075 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.726360 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.726459 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.726702 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.726855 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.727029 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.727170 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.727350 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.727498 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.727669 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.727814 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.727993 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.728131 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.728307 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.728471 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.728629 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.728720 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.728946 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.729084 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.729264 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.729418 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.729584 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.729722 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.729905 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.730051 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.730260 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.730405 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.730584 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.730723 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.730930 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.731064 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.731251 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.731419 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.731555 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.731698 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.731875 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.732011 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.732209 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.732350 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.732512 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.732659 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.732844 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.733233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.733447 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.733590 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.733765 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.733925 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.734098 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.734228 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.734449 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.734555 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.734768 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.734855 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.735083 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.735169 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.735399 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.735536 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.735712 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.735809 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.736040 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.736128 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.736366 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.736460 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.736682 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.736805 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.737007 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.737131 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.737325 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.737453 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.737641 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.737773 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.737957 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.738095 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.738335 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.738423 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.738603 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.738771 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.738945 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.739088 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.739265 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.739404 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.739586 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.739724 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.739902 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.740050 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.740224 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.740371 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.740543 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.740691 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.740860 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.741011 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.741177 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.741326 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.741498 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.741639 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.741808 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.741952 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.742132 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.742298 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.742459 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.742614 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.742782 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.743064 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.743159 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.743408 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.743494 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.743724 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.743817 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.744063 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.744148 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.744375 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.744474 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.744695 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.744804 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.745007 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.745091 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.745324 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.745410 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.745636 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.745743 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.745951 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.746227 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.746328 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.746628 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.746742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.746964 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.747164 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.747281 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.747505 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.747589 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.747830 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.747929 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.748149 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.748235 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.748484 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.748569 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.748801 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.748894 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.749115 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.749205 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.749433 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.749598 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.749750 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.750065 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.750171 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.750420 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.750537 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.750737 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.750824 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.751056 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.751221 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.751404 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.751562 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.751743 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.751890 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.752059 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.752198 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.752392 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.752530 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.752727 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.752864 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.753051 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.753333 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.753479 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.753664 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.753815 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.753963 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.754107 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.754299 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.754438 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.754612 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.754781 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.754928 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.755064 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.755223 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.755369 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.755518 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.755653 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.755826 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.756083 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.756221 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.756431 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.756577 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.756759 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.757007 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.757152 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.757329 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.757466 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.757646 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.757794 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.757938 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.758085 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.758292 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.758441 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.758611 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.758754 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.758930 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.759075 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.759246 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.759395 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.759561 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.759701 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.759875 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.760022 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.760206 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.760366 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.760525 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.760664 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.760841 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.760979 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.761157 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.761303 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.761471 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.761617 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.761786 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.761886 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.762108 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.762751 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.762976 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.763065 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.763293 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.763380 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.763607 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.763694 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.763923 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.764011 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.764235 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.764322 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.764557 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.764656 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.764870 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.764958 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.765191 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.765279 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.765506 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.765593 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.765838 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.765926 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.766177 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.766269 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.766504 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.766625 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.766815 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.766910 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.767132 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.767228 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.767445 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.767534 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.767760 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.767846 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.768073 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.768174 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.768406 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.768496 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.768707 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.768797 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.769019 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.769186 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.769335 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.769430 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.769646 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.769731 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.769961 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.770057 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.770295 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.770383 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.770616 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.770704 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.770924 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.771023 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.771239 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.771327 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.771552 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.771679 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.771882 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.771974 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.772191 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.772287 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.772508 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.772598 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.772818 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.772905 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.773136 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.773222 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.773449 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.773536 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.773764 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.773853 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.774073 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.774175 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.774405 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.774502 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.774719 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.774808 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.775038 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.775126 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.775351 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.775446 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.775662 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.775751 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.775970 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.776057 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.776279 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.776378 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.776588 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.776674 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.776894 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.776981 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.777200 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.777305 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.777512 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.777601 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.777888 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.777983 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.778737 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.778844 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.779056 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.779145 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.779368 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.779456 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.779680 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.779769 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.779996 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.780084 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.780321 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.780408 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.780635 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.780722 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.780941 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.781028 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.781249 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.781337 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.781556 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.781645 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.781866 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.782006 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.782218 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.782355 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.782528 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.782665 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.782839 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.782983 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.783151 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.783293 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.783463 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.783601 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.783778 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.783921 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.784093 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.784235 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.784407 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.784552 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.784729 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.784866 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.785047 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.785192 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.785358 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.785491 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.785673 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.785820 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.785987 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.786187 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.786324 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.786470 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.786608 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.786743 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.786936 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.787106 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.787238 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.787392 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.787547 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.787692 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.787860 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.787998 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.788168 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.788312 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.788482 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.788627 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.788798 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.788935 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.789113 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.789375 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.789514 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.789717 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.789873 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.790008 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.790165 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.790355 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.790491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.790683 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.790821 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.791005 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.791256 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.791395 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.791597 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.791748 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.791924 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.792064 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.792240 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.792339 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.792566 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.792654 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.792884 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.792971 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.793200 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.793289 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.794029 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.794154 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.794368 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.794459 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.794680 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.794841 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.794992 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.795080 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.795308 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.795408 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.795618 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.795706 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.795926 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.796013 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.796235 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.796335 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.796545 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.796631 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.796857 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.796944 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.797162 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.797262 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.797470 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.797556 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.797776 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.797863 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.798082 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.798190 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.798419 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.798516 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.798726 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.798821 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.799034 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.799123 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.799343 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.799432 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.799652 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.799738 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.799982 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.800071 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.800299 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.800387 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.800611 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.800707 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.800920 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.801009 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.801230 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.801318 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.801571 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.801667 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.801882 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.802005 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.802224 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.802315 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.802537 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.802639 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.802848 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.802948 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.803170 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.803257 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.803484 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.803581 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.803793 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.803881 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.804110 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.804197 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.804416 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.804516 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.804728 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.804815 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.805042 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.805130 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.805348 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.805435 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.805653 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.805739 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.805960 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.806047 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.806301 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.806391 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.806619 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.806707 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.806934 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.807022 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.807244 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.807334 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.807559 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.807655 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.807871 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.807960 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.808177 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.808276 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.808490 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.808584 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.808795 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.808896 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.809777 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.809884 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.809967 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.810048 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.810299 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.810406 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.810610 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.810699 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.810927 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.811027 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.811237 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.811335 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.811542 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.811629 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.811860 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.811948 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.812171 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.812272 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.812479 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.812566 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.812788 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.812889 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.813100 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.813188 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.813405 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.813492 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.813713 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.813801 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.814027 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.814155 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.814364 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.814462 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.814679 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.814776 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.814985 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.815073 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.815292 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.815420 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.815598 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.815684 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.815906 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.816004 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.816214 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.816340 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.816528 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.816631 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.816834 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.816928 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.817138 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.817224 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.817445 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.817540 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.817749 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.817835 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.818055 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.818196 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.818395 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.818494 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.818705 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.818793 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.819010 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.819096 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.819319 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.819447 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.819622 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.819721 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.819927 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.820022 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.820255 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.820359 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.820569 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.820664 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.820878 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.820982 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.821187 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.821283 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.821494 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.821596 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.821817 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.821920 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.822149 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.822251 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.822470 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.822629 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.822780 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.822869 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.823098 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.823188 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.823411 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.823499 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.823726 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.823891 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.824031 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.824126 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.824337 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.824426 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.824668 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.824768 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.824985 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.825080 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.825297 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.825392 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.825615 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.825715 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.825924 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.826013 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.826257 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.826347 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.826574 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.826673 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.826887 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.826975 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.827202 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.827290 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.827514 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.827611 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.827826 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.827914 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.828139 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.828226 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.828446 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.828541 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.828758 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.828845 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.829071 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.829166 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.829382 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.829470 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.829693 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.829779 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.829999 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.830093 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.830336 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.830426 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.830649 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.830737 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.830957 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.831045 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.831273 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.831369 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.831583 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.831670 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.831891 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.831987 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.832198 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.832332 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.832510 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.832617 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.832814 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.832916 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.833118 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.833204 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.833443 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.833550 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.833753 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.833894 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.834065 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.834219 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.834403 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.834531 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.834724 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.834847 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.835033 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.835161 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.835470 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.835569 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.835784 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.835878 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.836092 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.836177 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.836399 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.836501 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.836714 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.836809 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.837027 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.837121 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.837350 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.837435 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.837670 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.837756 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.837979 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.838064 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.838338 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.838425 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.838667 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.838754 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.838975 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.839061 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.839281 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.839375 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.839589 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.839675 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.839913 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.839998 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.840220 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.840324 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.840570 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.840654 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.840880 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.840974 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.841189 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.841283 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.841497 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.841590 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.841824 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.841988 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.842151 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.842341 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.842550 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.842653 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.842905 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.842992 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.843221 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.843307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.843530 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.843615 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.843876 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.843968 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.844193 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.844280 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.844504 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.844589 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.844830 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.844937 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.845155 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.845250 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.845470 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.845557 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.845785 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.845871 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.846093 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.846190 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.846442 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.846544 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.846766 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.846858 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.847081 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.847166 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.847396 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.847495 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.847715 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.847801 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.848027 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.848123 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.848354 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.848448 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.848681 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.848767 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.849000 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.849098 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.849325 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.849420 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.849631 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.849743 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.849944 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.850070 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.850277 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.850411 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.850584 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.850738 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.850912 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.851069 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.851218 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.851380 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.851534 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.851690 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.851846 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.852005 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.852202 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.852298 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.852464 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.852638 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.852776 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.852944 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.853090 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.853252 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.853394 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.853569 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.853717 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.853884 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.854035 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.854226 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.854398 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.854539 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.854723 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.854851 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.855033 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.855178 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.855358 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.855488 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.855670 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.855814 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.856492 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.856650 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.856803 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.856978 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.857110 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.857301 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.857455 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.857610 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.857766 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.857938 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.858376 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.858539 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.858712 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.858850 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.859045 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.859163 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.859361 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.859472 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.859696 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.859819 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.860025 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.860134 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.860344 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.860460 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.860663 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.860794 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.860990 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.861127 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.861298 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.861442 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.861604 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.861779 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.861918 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.862110 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.862235 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.862457 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.862552 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.862784 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.862906 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.863114 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.863206 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.863425 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.863514 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.863729 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.863818 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.864034 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.864130 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.864342 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.864437 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.864655 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.864751 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.864961 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.865057 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.865272 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.865361 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.865578 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.865670 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.865891 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.865978 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.866209 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.866307 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.866535 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.866624 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.866862 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.866950 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.867172 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.867279 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.867484 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.867574 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.867795 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.867890 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.868104 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.868201 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.868412 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.868508 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.868733 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.868821 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.869052 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.869150 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.869370 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.869466 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.869689 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.869784 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.870007 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.870110 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.870353 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.870443 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.870666 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.870753 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.870979 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.871068 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.871292 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.871381 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.872148 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.872253 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.872478 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.872568 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.872798 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.872927 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.873120 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.873322 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.873442 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.873655 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.873751 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.873976 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.874064 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.874320 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.874422 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.874642 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.874730 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.874962 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.875050 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.875281 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.875575 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.875672 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.875867 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.875956 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.876190 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.876297 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.876500 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.876588 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.876817 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.876904 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.877137 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.877239 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.877457 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.877546 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.877775 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.877863 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.878093 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.878249 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.878433 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.878521 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.878748 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.878835 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.879064 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.879152 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.879397 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.879485 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.879727 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.879890 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.880035 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.880122 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.880352 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.880448 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.880671 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.880769 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.880988 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.881077 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.881302 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.881388 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.881619 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.881718 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.881937 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.882025 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.882278 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.882371 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.882596 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.882694 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.882915 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.883049 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.883233 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.883320 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.883548 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.883636 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.883865 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.883954 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.884182 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.884270 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.884500 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.884590 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.884814 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.884900 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.885131 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.885228 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.885446 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.885541 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.885766 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.885969 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.886095 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.886323 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.886459 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.886672 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.886774 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.887002 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.887097 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.887353 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.887446 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.887674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.887765 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.887995 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.888238 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.888327 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.888558 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.888654 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.888898 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.888993 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.889218 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.889314 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.889529 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.889617 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.889837 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.889926 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.890186 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.890278 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.890503 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.890591 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.890811 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.890899 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.891119 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.891207 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.891432 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.891519 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.891750 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.891971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.892069 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.892324 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.892411 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.892643 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.892731 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.892970 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.893058 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.893296 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.893391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.893606 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.893694 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.893912 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.894167 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.894259 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.894524 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.894613 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.894851 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.894941 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.895170 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.895257 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.895486 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.895586 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.895793 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.895891 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.896099 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.896188 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.896413 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.896510 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.896725 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.896822 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.897030 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.897117 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.897343 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.897432 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.897650 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.897740 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.897959 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.898053 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.898296 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.898398 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.898601 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.898688 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.898908 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.898996 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.899215 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.899312 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.899519 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.899606 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.899824 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.899922 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.900131 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.900229 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.900437 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.900526 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.900744 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.900830 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.901047 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.901143 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.901358 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.901446 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.901663 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.901750 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.901970 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.902068 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.902300 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.902388 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.902612 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.902702 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.902949 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.903107 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.903261 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.903352 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.903575 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.903663 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.903885 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.903974 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.904198 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.904287 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.904506 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.904596 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.904824 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.904914 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.905134 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.905221 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.905448 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.905535 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.905786 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.905874 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.906092 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.906219 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.906436 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.906646 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.906736 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.906980 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.907068 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.907301 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.907427 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.907634 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.907723 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.907966 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.908056 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.908275 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.908363 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.908584 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.908833 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.908922 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.909176 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.909264 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.909502 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.909591 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.909816 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.909913 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.910147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.910239 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.910465 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.910555 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.910777 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.910865 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.911088 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.911176 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.911401 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.911491 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.911716 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.911812 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.912030 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.912118 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.912340 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.912439 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.912652 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.912739 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.912962 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.913058 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.913276 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.913372 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.913590 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.913686 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.913907 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.914009 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.914252 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.914370 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.914566 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.914665 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.914883 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.914981 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.915193 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.915279 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.915504 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.915599 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.915815 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.915910 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.916139 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.916225 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.916461 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.916575 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.916776 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.916873 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.917090 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.917178 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.917415 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.917552 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.917706 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.917795 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.918020 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.918108 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.918858 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.918968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.919192 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.919281 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.919535 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.919624 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.919858 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.919955 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.920172 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.920268 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.920487 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.920596 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.920811 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.920908 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.921126 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.921213 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.921457 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.921553 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.921795 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.921892 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.922149 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.922241 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.922475 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.922574 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.922791 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.922880 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.923099 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.923197 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.923408 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.923500 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.923720 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.923809 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.924040 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.924129 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.924353 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.924449 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.924661 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.924748 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.924965 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.925052 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.925276 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.925374 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.925585 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.925681 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.925893 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.925980 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.926233 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.926339 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.926572 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.926687 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.926845 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.926934 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.927149 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.927255 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.927456 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.927551 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.927761 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.927852 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.928066 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.928155 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.928371 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.928457 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.928674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.928763 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.928985 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.929074 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.929288 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.929385 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.929594 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.929681 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.929897 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.929985 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.930231 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.930322 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.930535 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.930623 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.930841 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.930937 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.931155 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.931253 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.931466 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.931563 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.931774 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.931862 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.932080 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.932178 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.932388 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.932485 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.932696 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.932783 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.933017 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.933104 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.933338 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.933436 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.933654 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.933742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.934016 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.934692 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.934897 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.935026 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.935147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.935274 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.935462 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.935559 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.935778 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.935878 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.936093 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.936190 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.936408 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.936495 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.936724 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.936825 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.937049 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.937137 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.937363 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.937450 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.937678 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.937817 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.937992 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.938082 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.938336 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.938440 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.938654 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.938743 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.938970 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.939059 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.939284 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.939445 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.939617 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.939706 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.939925 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.940013 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.940235 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.940333 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.940554 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.940642 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.940867 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.940955 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.941182 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.941283 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.941497 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.941585 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.941813 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.941907 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.942150 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.942243 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.942474 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.942565 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.942799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.942894 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.943116 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.943206 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.943435 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.943523 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.943756 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.943845 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.944077 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.944180 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.944410 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.944499 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.944725 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.944821 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.945040 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.945130 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.945349 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.945439 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.945596 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 22:53:29.945722 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.946042 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.946420 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.946762 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.947084 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.947402 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.947715 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 22:53:29.947965 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 22:53:29.968674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_db.sqlalchemy.engines [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 22:53:29.970549 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG oslo_db.sqlalchemy.engines [None req-e76a00f9-5b95-4449-82ea-05476fd50d78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 22:53:30.035351 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.context [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e865ace6-4b09-4716-9268-ae08e665ea6e(cell1) {{(pid=102609) load_cells /opt/stack/nova/nova/context.py:464}} May 09 22:53:30.035598 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.context [None req-e76a00f9-5b95-4449-82ea-05476fd50d78 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e865ace6-4b09-4716-9268-ae08e665ea6e(cell1) {{(pid=102610) load_cells /opt/stack/nova/nova/context.py:464}} May 09 22:53:30.039714 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-e76a00f9-5b95-4449-82ea-05476fd50d78 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 22:53:30.040646 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 22:53:30.041809 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-e76a00f9-5b95-4449-82ea-05476fd50d78 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 22:53:30.042290 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 22:53:30.042843 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-e76a00f9-5b95-4449-82ea-05476fd50d78 None None] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 22:53:30.044107 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 22:53:30.045391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-e76a00f9-5b95-4449-82ea-05476fd50d78 None None] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 22:53:30.046846 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 22:53:30.060526 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_db.sqlalchemy.engines [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 22:53:30.061792 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG oslo_db.sqlalchemy.engines [None req-e76a00f9-5b95-4449-82ea-05476fd50d78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 22:53:30.065683 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_db.sqlalchemy.engines [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 22:53:30.070849 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG oslo_db.sqlalchemy.engines [None req-e76a00f9-5b95-4449-82ea-05476fd50d78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 22:53:30.222002 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_db.sqlalchemy.engines [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 22:53:30.225445 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG oslo_db.sqlalchemy.engines [None req-e76a00f9-5b95-4449-82ea-05476fd50d78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 22:53:30.560812 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: WARNING keystonemiddleware.auth_token [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 22:53:30.565806 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: WARNING keystonemiddleware.auth_token [None req-e76a00f9-5b95-4449-82ea-05476fd50d78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 22:53:30.568127 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: WARNING keystonemiddleware.auth_token [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 22:53:30.573136 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: WARNING keystonemiddleware.auth_token [None req-e76a00f9-5b95-4449-82ea-05476fd50d78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 22:53:30.909866 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: WARNING keystonemiddleware.auth_token [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 22:53:30.915918 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: WARNING keystonemiddleware.auth_token [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 22:53:30.918635 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: WARNING keystonemiddleware.auth_token [None req-e76a00f9-5b95-4449-82ea-05476fd50d78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 22:53:30.922051 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bd371c09c0 pid: 102609 (default app) May 09 22:53:30.924131 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:53:30.924720 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: WARNING keystonemiddleware.auth_token [None req-e76a00f9-5b95-4449-82ea-05476fd50d78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 22:53:30.925296 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 May 09 22:53:30.925717 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Mon May 9 22:53:30 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:53:30.930988 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bd371c09c0 pid: 102610 (default app) May 09 22:54:48.536529 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:54:48.537547 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 09 22:54:48.537951 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Mon May 9 22:54:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:54:48.961238 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-538c0b3f-330a-4557-89f7-f815b77920e2 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:54:48.990166 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-538c0b3f-330a-4557-89f7-f815b77920e2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.444866 May 09 22:54:48.990842 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Mon May 9 22:54:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 22:54:51.260197 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:54:51.261186 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-a9e2157d-6be2-4afc-a81e-9d55cac177fd None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002010 May 09 22:54:51.261591 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Mon May 9 22:54:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:54:51.323376 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-e5ed34bb-78bc-473d-b932-54e7f42b5798 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "id": "c1", "disk": 1}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:54:51.341867 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 22:54:51.341867 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: warnings.warn(msg) May 09 22:54:51.370052 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-e5ed34bb-78bc-473d-b932-54e7f42b5798 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102566 May 09 22:54:51.370818 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Mon May 9 22:54:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 22:54:51.588258 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-5278b6ce-f821-4fc6-9f35-116959d249c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:54:51.590581 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 22:54:51.590581 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: warnings.warn(msg) May 09 22:54:51.663368 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-5278b6ce-f821-4fc6-9f35-116959d249c3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284613 May 09 22:54:51.664762 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Mon May 9 22:54:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 22:54:53.962547 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-e5ed34bb-78bc-473d-b932-54e7f42b5798 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:54:53.963519 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-e5ed34bb-78bc-473d-b932-54e7f42b5798 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 09 22:54:53.963920 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Mon May 9 22:54:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:54:54.066399 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-d2267b4d-fb48-45ba-9fe1-5eaa72a5bfe5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:54:54.083898 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 22:54:54.083898 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: warnings.warn(msg) May 09 22:54:54.104232 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-d2267b4d-fb48-45ba-9fe1-5eaa72a5bfe5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134427 May 09 22:54:54.104985 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Mon May 9 22:54:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 22:54:54.116766 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-24e2bb8a-6cb4-42f9-9a64-ac370c6e523d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:54:54.118269 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 22:54:54.118269 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: warnings.warn(msg) May 09 22:54:54.148241 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-24e2bb8a-6cb4-42f9-9a64-ac370c6e523d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035186 May 09 22:54:54.149632 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Mon May 9 22:54:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 22:54:56.418871 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-d2267b4d-fb48-45ba-9fe1-5eaa72a5bfe5 admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:54:56.419894 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-d2267b4d-fb48-45ba-9fe1-5eaa72a5bfe5 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 09 22:54:56.420295 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Mon May 9 22:54:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:54:56.481892 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-03646ad1-3350-45db-bb6a-51ffae2e185e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "vcpus": 1}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:54:56.502411 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-03646ad1-3350-45db-bb6a-51ffae2e185e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076308 May 09 22:54:56.503055 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Mon May 9 22:54:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 22:54:56.515573 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-f76764da-05df-418d-a6ac-499b3129e29b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:54:56.537746 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-f76764da-05df-418d-a6ac-499b3129e29b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025943 May 09 22:54:56.538542 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Mon May 9 22:54:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 22:54:58.818754 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-03646ad1-3350-45db-bb6a-51ffae2e185e admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:54:58.819942 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-03646ad1-3350-45db-bb6a-51ffae2e185e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001661 May 09 22:54:58.820371 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Mon May 9 22:54:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:54:58.888877 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-aafb577b-e24a-4c17-9f6f-05bcda00afa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "vcpus": 2, "ram": 2048}} {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:54:58.907557 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-aafb577b-e24a-4c17-9f6f-05bcda00afa5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080161 May 09 22:54:58.908111 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Mon May 9 22:54:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 22:54:58.920430 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-40dcfeee-8f1e-4c1d-8eda-0cff9aadfe61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:54:58.943867 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-40dcfeee-8f1e-4c1d-8eda-0cff9aadfe61 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027030 May 09 22:54:58.944446 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Mon May 9 22:54:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 22:55:01.280278 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-aafb577b-e24a-4c17-9f6f-05bcda00afa5 admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:01.281285 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-aafb577b-e24a-4c17-9f6f-05bcda00afa5 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 09 22:55:01.281679 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Mon May 9 22:55:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:01.341266 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-f4fedeea-19b9-4ad6-8296-284e653bb634 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:01.359546 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-f4fedeea-19b9-4ad6-8296-284e653bb634 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071953 May 09 22:55:01.360697 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Mon May 9 22:55:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 22:55:01.372688 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-71f3cffd-0c18-475f-ba87-b12d3dc6fb68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:01.397793 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-71f3cffd-0c18-475f-ba87-b12d3dc6fb68 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028792 May 09 22:55:01.398722 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Mon May 9 22:55:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 22:55:03.700983 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-f4fedeea-19b9-4ad6-8296-284e653bb634 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:03.702952 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-f4fedeea-19b9-4ad6-8296-284e653bb634 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002358 May 09 22:55:03.703656 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Mon May 9 22:55:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:03.766830 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-af103a2c-dfdc-4edb-bb3c-799857fb7b02 admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:03.794637 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-af103a2c-dfdc-4edb-bb3c-799857fb7b02 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083859 May 09 22:55:03.803799 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Mon May 9 22:55:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 22:55:06.069193 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-f4fedeea-19b9-4ad6-8296-284e653bb634 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:06.070249 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-f4fedeea-19b9-4ad6-8296-284e653bb634 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 09 22:55:06.070665 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Mon May 9 22:55:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:06.132228 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-58f0f9c9-7b55-45e3-bd51-700e6672f52f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "id": "1", "os-flavor-access:is_public": true, "swap": 0, "ram": 512}} {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:06.149507 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-58f0f9c9-7b55-45e3-bd51-700e6672f52f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072398 May 09 22:55:06.150053 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Mon May 9 22:55:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 22:55:06.163173 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-dc25fcc3-bf58-421f-aedc-3db0e98236a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:06.190892 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-dc25fcc3-bf58-421f-aedc-3db0e98236a2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032436 May 09 22:55:06.191740 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Mon May 9 22:55:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 22:55:08.617068 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-58f0f9c9-7b55-45e3-bd51-700e6672f52f admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:08.618656 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-58f0f9c9-7b55-45e3-bd51-700e6672f52f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 May 09 22:55:08.619080 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Mon May 9 22:55:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:08.687330 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-55adf2c0-5059-44ff-aee7-05e118d57de9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "ram": 2048, "id": "2"}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:08.704594 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-55adf2c0-5059-44ff-aee7-05e118d57de9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079282 May 09 22:55:08.705213 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Mon May 9 22:55:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 22:55:08.717060 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-f227a39d-5360-484e-bc59-f74718893e76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:08.740122 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-f227a39d-5360-484e-bc59-f74718893e76 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026783 May 09 22:55:08.740686 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Mon May 9 22:55:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 22:55:11.060529 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-55adf2c0-5059-44ff-aee7-05e118d57de9 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:11.061556 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-55adf2c0-5059-44ff-aee7-05e118d57de9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 09 22:55:11.062132 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Mon May 9 22:55:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:11.120157 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-a0c34c9e-b63c-46a5-90b4-4b4d0d6cb87d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3"}} {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:11.137076 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-a0c34c9e-b63c-46a5-90b4-4b4d0d6cb87d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069603 May 09 22:55:11.137696 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Mon May 9 22:55:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 22:55:11.149222 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-da6f79d3-b4d0-4788-9415-520df0f70730 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:11.171535 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-da6f79d3-b4d0-4788-9415-520df0f70730 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025942 May 09 22:55:11.172278 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Mon May 9 22:55:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 22:55:13.457695 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-a0c34c9e-b63c-46a5-90b4-4b4d0d6cb87d admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:13.458733 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-a0c34c9e-b63c-46a5-90b4-4b4d0d6cb87d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 09 22:55:13.459316 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Mon May 9 22:55:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 22:55:13.517916 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-9fc039c1-7f82-4cd5-be8c-8e6ab819ce67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:13.536471 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-9fc039c1-7f82-4cd5-be8c-8e6ab819ce67 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071680 May 09 22:55:13.537217 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Mon May 9 22:55:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 22:55:13.549355 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-a302afb2-de56-411c-b196-a68e8b83e636 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:13.571779 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-a302afb2-de56-411c-b196-a68e8b83e636 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026011 May 09 22:55:13.572265 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Mon May 9 22:55:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 22:55:15.850843 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-9fc039c1-7f82-4cd5-be8c-8e6ab819ce67 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:15.852552 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-9fc039c1-7f82-4cd5-be8c-8e6ab819ce67 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002198 May 09 22:55:15.852960 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Mon May 9 22:55:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:15.915638 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-6c3a669a-58c3-4e4d-93f6-f83866cb9f1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:15.940898 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-6c3a669a-58c3-4e4d-93f6-f83866cb9f1e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081885 May 09 22:55:15.941444 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Mon May 9 22:55:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 22:55:15.953568 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-4c3d4355-4988-45fb-9615-275ca9a6702a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:15.981458 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-4c3d4355-4988-45fb-9615-275ca9a6702a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031794 May 09 22:55:15.982055 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Mon May 9 22:55:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 22:55:40.146489 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-6c3a669a-58c3-4e4d-93f6-f83866cb9f1e admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:40.147508 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-6c3a669a-58c3-4e4d-93f6-f83866cb9f1e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 May 09 22:55:40.147915 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Mon May 9 22:55:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:40.204164 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-ce45d773-508e-42ca-87b5-a06750870209 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:40.221740 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-ce45d773-508e-42ca-87b5-a06750870209 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067874 May 09 22:55:40.222300 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Mon May 9 22:55:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 22:55:41.227858 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-6c3a669a-58c3-4e4d-93f6-f83866cb9f1e admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:41.228869 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-6c3a669a-58c3-4e4d-93f6-f83866cb9f1e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 09 22:55:41.229271 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Mon May 9 22:55:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:41.424165 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-64bdcce3-6f04-41a4-bba8-d7f415f643dd admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:41.429721 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.wsgi [None req-64bdcce3-6f04-41a4-bba8-d7f415f643dd admin admin] HTTP exception thrown: Flavor 42 could not be found. May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-64bdcce3-6f04-41a4-bba8-d7f415f643dd admin admin] Request method failure captured: May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Accept: application/json May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Accept-Encoding: gzip, deflate May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Connection: keep-alive May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Content-Length: 0 May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Host: 10.222.0.23 May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Openstack-Api-Version: compute 2.90 May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Openstack-System-Scope: None May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: User-Agent: python-novaclient May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Auth-Token: gAAAAABieZvtSNDawF1z96zK2KmHzl4uK4n6ToFke9rVW4Dy4OnefVJfnSfq-uXfFUG9OVjf-O_exMS8wixX44T4CJ5p_qRy4ylMtfvBhnz6Ltn_jvLBZVXEU_JGfbXKTBa0Y8XXwkXxVqUrjgsInbrx4lHcAgnfekXvAZ2QEuYk-eiN1bTeN94 May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Domain-Id: None May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Domain-Name: None May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Identity-Status: Confirmed May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Is-Admin-Project: True May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Openstack-Nova-Api-Version: 2.90 May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Project-Domain-Id: default May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Project-Domain-Name: Default May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Project-Id: 4202d89a17374bc0a3d992386d254d4c May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Project-Name: admin May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Role: admin,reader,member May 09 22:55:41.433461 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Roles: admin,reader,member May 09 22:55:41.434986 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 22:55:41.434986 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Tenant: admin May 09 22:55:41.434986 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Tenant-Id: 4202d89a17374bc0a3d992386d254d4c May 09 22:55:41.434986 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Tenant-Name: admin May 09 22:55:41.434986 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User: admin May 09 22:55:41.434986 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User-Domain-Id: default May 09 22:55:41.434986 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User-Domain-Name: Default May 09 22:55:41.434986 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User-Id: 873ba60d483a41a4b36c04c1aa8b34ad May 09 22:55:41.434986 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User-Name: admin May 09 22:55:41.434986 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: method: > May 09 22:55:41.434986 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: exception: Flavor 42 could not be found. May 09 22:55:41.434986 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: action_args: {'id': '42'} May 09 22:55:41.434986 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 22:55:41.434986 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 22:55:41.435909 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:41.437391 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-64bdcce3-6f04-41a4-bba8-d7f415f643dd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 22:55:41.438764 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-64bdcce3-6f04-41a4-bba8-d7f415f643dd admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060506 May 09 22:55:41.438764 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Mon May 9 22:55:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 22:55:41.444544 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-a14f2a9e-b674-47d3-a60b-2fc0daf45391 admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:41.466551 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-a14f2a9e-b674-47d3-a60b-2fc0daf45391 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025560 May 09 22:55:41.467081 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Mon May 9 22:55:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 22:55:41.490716 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-622ed34a-fbe7-4e29-8249-f4240d5d252a admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:41.512413 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-622ed34a-fbe7-4e29-8249-f4240d5d252a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025288 May 09 22:55:41.512948 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Mon May 9 22:55:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 22:55:41.521802 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-df189ffe-c7b8-401e-bffb-9b5a5220e81a admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:41.527176 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.wsgi [None req-df189ffe-c7b8-401e-bffb-9b5a5220e81a admin admin] HTTP exception thrown: Flavor 42 could not be found. May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-df189ffe-c7b8-401e-bffb-9b5a5220e81a admin admin] Request method failure captured: May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Accept: application/json May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Accept-Encoding: gzip, deflate May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Connection: keep-alive May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Content-Length: 0 May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Host: 10.222.0.23 May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Openstack-Api-Version: compute 2.90 May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Openstack-System-Scope: None May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: User-Agent: python-novaclient May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Auth-Token: gAAAAABieZvtSNDawF1z96zK2KmHzl4uK4n6ToFke9rVW4Dy4OnefVJfnSfq-uXfFUG9OVjf-O_exMS8wixX44T4CJ5p_qRy4ylMtfvBhnz6Ltn_jvLBZVXEU_JGfbXKTBa0Y8XXwkXxVqUrjgsInbrx4lHcAgnfekXvAZ2QEuYk-eiN1bTeN94 May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Domain-Id: None May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Domain-Name: None May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Identity-Status: Confirmed May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Is-Admin-Project: True May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Openstack-Nova-Api-Version: 2.90 May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Project-Domain-Id: default May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Project-Domain-Name: Default May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Project-Id: 4202d89a17374bc0a3d992386d254d4c May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Project-Name: admin May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Role: admin,reader,member May 09 22:55:41.530483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Roles: admin,reader,member May 09 22:55:41.532012 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 22:55:41.532012 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Tenant: admin May 09 22:55:41.532012 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Tenant-Id: 4202d89a17374bc0a3d992386d254d4c May 09 22:55:41.532012 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Tenant-Name: admin May 09 22:55:41.532012 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User: admin May 09 22:55:41.532012 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User-Domain-Id: default May 09 22:55:41.532012 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User-Domain-Name: Default May 09 22:55:41.532012 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User-Id: 873ba60d483a41a4b36c04c1aa8b34ad May 09 22:55:41.532012 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User-Name: admin May 09 22:55:41.532012 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: method: > May 09 22:55:41.532012 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: exception: Flavor 42 could not be found. May 09 22:55:41.532012 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: action_args: {'id': '42'} May 09 22:55:41.532012 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 22:55:41.532012 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 22:55:41.533001 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:41.534079 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-df189ffe-c7b8-401e-bffb-9b5a5220e81a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 22:55:41.535220 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-df189ffe-c7b8-401e-bffb-9b5a5220e81a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013568 May 09 22:55:41.535220 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Mon May 9 22:55:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 22:55:42.417712 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-622ed34a-fbe7-4e29-8249-f4240d5d252a admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:42.418774 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-622ed34a-fbe7-4e29-8249-f4240d5d252a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 09 22:55:42.419173 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Mon May 9 22:55:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:42.612391 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-87df74a0-c89c-40d8-a8ba-ffa343429d3f admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:42.618182 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.wsgi [None req-87df74a0-c89c-40d8-a8ba-ffa343429d3f admin admin] HTTP exception thrown: Flavor 84 could not be found. May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-87df74a0-c89c-40d8-a8ba-ffa343429d3f admin admin] Request method failure captured: May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Accept: application/json May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Accept-Encoding: gzip, deflate May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Connection: keep-alive May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Content-Length: 0 May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Host: 10.222.0.23 May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Openstack-Api-Version: compute 2.90 May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Openstack-System-Scope: None May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: User-Agent: python-novaclient May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Auth-Token: gAAAAABieZvuk395VmYJSkfmNoXB8lhncnCDpPgdIU3vjcAigpciFeHzqi6FYeQ5zTq5O_bcrHFBszOIzfH_e5rKhzyuA2lQstHjHj6s48fkVAS8VXsX_xvbdaB1ebr7QzIJZoVFz5djR9Ou011eSbO5iVAmWPdkDxNp9r1u_f0zHkI1Xlp6hy0 May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Domain-Id: None May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Domain-Name: None May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Identity-Status: Confirmed May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Is-Admin-Project: True May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Openstack-Nova-Api-Version: 2.90 May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Project-Domain-Id: default May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Project-Domain-Name: Default May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Project-Id: 4202d89a17374bc0a3d992386d254d4c May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Project-Name: admin May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Role: admin,reader,member May 09 22:55:42.619674 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Roles: admin,reader,member May 09 22:55:42.621147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 22:55:42.621147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Tenant: admin May 09 22:55:42.621147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Tenant-Id: 4202d89a17374bc0a3d992386d254d4c May 09 22:55:42.621147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Tenant-Name: admin May 09 22:55:42.621147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User: admin May 09 22:55:42.621147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User-Domain-Id: default May 09 22:55:42.621147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User-Domain-Name: Default May 09 22:55:42.621147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User-Id: 873ba60d483a41a4b36c04c1aa8b34ad May 09 22:55:42.621147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User-Name: admin May 09 22:55:42.621147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: method: > May 09 22:55:42.621147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: exception: Flavor 84 could not be found. May 09 22:55:42.621147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: action_args: {'id': '84'} May 09 22:55:42.621147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 22:55:42.621147 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 22:55:42.621968 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:42.623070 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-87df74a0-c89c-40d8-a8ba-ffa343429d3f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 22:55:42.624198 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-87df74a0-c89c-40d8-a8ba-ffa343429d3f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059468 May 09 22:55:42.624198 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Mon May 9 22:55:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 22:55:42.630963 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-7e17804b-0330-4ce3-a968-89b3c9282857 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:42.644320 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-7e17804b-0330-4ce3-a968-89b3c9282857 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017005 May 09 22:55:42.644866 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Mon May 9 22:55:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 22:55:42.654205 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-db2022f6-cf08-4e37-91d2-aee7d9d07f01 admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:42.668473 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-db2022f6-cf08-4e37-91d2-aee7d9d07f01 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017814 May 09 22:55:42.669009 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Mon May 9 22:55:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 22:55:42.677972 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-3d6b00af-4661-4d4e-ad59-0671300eb831 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:42.683824 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.wsgi [None req-3d6b00af-4661-4d4e-ad59-0671300eb831 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-3d6b00af-4661-4d4e-ad59-0671300eb831 admin admin] Request method failure captured: May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Accept: application/json May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Accept-Encoding: gzip, deflate May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Connection: keep-alive May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Content-Length: 0 May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Host: 10.222.0.23 May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Openstack-Api-Version: compute 2.90 May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Openstack-System-Scope: None May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: User-Agent: python-novaclient May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Auth-Token: gAAAAABieZvuk395VmYJSkfmNoXB8lhncnCDpPgdIU3vjcAigpciFeHzqi6FYeQ5zTq5O_bcrHFBszOIzfH_e5rKhzyuA2lQstHjHj6s48fkVAS8VXsX_xvbdaB1ebr7QzIJZoVFz5djR9Ou011eSbO5iVAmWPdkDxNp9r1u_f0zHkI1Xlp6hy0 May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Domain-Id: None May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Domain-Name: None May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Identity-Status: Confirmed May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Is-Admin-Project: True May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Openstack-Nova-Api-Version: 2.90 May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Project-Domain-Id: default May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Project-Domain-Name: Default May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Project-Id: 4202d89a17374bc0a3d992386d254d4c May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Project-Name: admin May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Role: admin,reader,member May 09 22:55:42.685309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Roles: admin,reader,member May 09 22:55:42.686854 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 22:55:42.686854 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Tenant: admin May 09 22:55:42.686854 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Tenant-Id: 4202d89a17374bc0a3d992386d254d4c May 09 22:55:42.686854 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Tenant-Name: admin May 09 22:55:42.686854 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User: admin May 09 22:55:42.686854 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User-Domain-Id: default May 09 22:55:42.686854 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User-Domain-Name: Default May 09 22:55:42.686854 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User-Id: 873ba60d483a41a4b36c04c1aa8b34ad May 09 22:55:42.686854 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User-Name: admin May 09 22:55:42.686854 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: method: > May 09 22:55:42.686854 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: exception: Flavor 84 could not be found. May 09 22:55:42.686854 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: action_args: {'id': '84'} May 09 22:55:42.686854 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 22:55:42.686854 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 22:55:42.687742 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:42.688783 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-3d6b00af-4661-4d4e-ad59-0671300eb831 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 22:55:42.689827 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-3d6b00af-4661-4d4e-ad59-0671300eb831 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012242 May 09 22:55:42.689827 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Mon May 9 22:55:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 22:55:43.587405 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-db2022f6-cf08-4e37-91d2-aee7d9d07f01 admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:43.588475 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-db2022f6-cf08-4e37-91d2-aee7d9d07f01 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 09 22:55:43.588875 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Mon May 9 22:55:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:43.776187 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-624cafd3-aad9-4440-8e72-5c01640a3826 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:43.781728 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.wsgi [None req-624cafd3-aad9-4440-8e72-5c01640a3826 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-624cafd3-aad9-4440-8e72-5c01640a3826 admin admin] Request method failure captured: May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Accept: application/json May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Accept-Encoding: gzip, deflate May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Connection: keep-alive May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Content-Length: 0 May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Host: 10.222.0.23 May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Openstack-Api-Version: compute 2.90 May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Openstack-System-Scope: None May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: User-Agent: python-novaclient May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Auth-Token: gAAAAABieZvvRnAG3zFFRT4-aZ0__sQd5E7JZcF7WBVVkTkUxRo7BOMV1SarhCxdaPkD24jpALo6MCzO2va6za880ZHpA6VJ_AFn9J00TCj-pLimWsrXvBuk0e3yAqDCSS_AUrYD_1fBVLUUjbcAc4lGkNnSnjXz5HZKy_fncpm28EAPxrwSxc4 May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Domain-Id: None May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Domain-Name: None May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Identity-Status: Confirmed May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Is-Admin-Project: True May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Openstack-Nova-Api-Version: 2.90 May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Project-Domain-Id: default May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Project-Domain-Name: Default May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Project-Id: 4202d89a17374bc0a3d992386d254d4c May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Project-Name: admin May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Role: admin,reader,member May 09 22:55:43.783265 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Roles: admin,reader,member May 09 22:55:43.784788 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 22:55:43.784788 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Tenant: admin May 09 22:55:43.784788 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Tenant-Id: 4202d89a17374bc0a3d992386d254d4c May 09 22:55:43.784788 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-Tenant-Name: admin May 09 22:55:43.784788 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User: admin May 09 22:55:43.784788 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User-Domain-Id: default May 09 22:55:43.784788 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User-Domain-Name: Default May 09 22:55:43.784788 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User-Id: 873ba60d483a41a4b36c04c1aa8b34ad May 09 22:55:43.784788 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: X-User-Name: admin May 09 22:55:43.784788 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: method: > May 09 22:55:43.784788 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: exception: Flavor 451 could not be found. May 09 22:55:43.784788 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: action_args: {'id': '451'} May 09 22:55:43.784788 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 22:55:43.784788 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 22:55:43.785799 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 09 22:55:43.787233 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-624cafd3-aad9-4440-8e72-5c01640a3826 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 22:55:43.788524 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-624cafd3-aad9-4440-8e72-5c01640a3826 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060901 May 09 22:55:43.788524 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Mon May 9 22:55:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 22:55:43.796892 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-bfb27849-91e7-404a-b3f4-1c5d00f7afcb admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:43.811420 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-bfb27849-91e7-404a-b3f4-1c5d00f7afcb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020255 May 09 22:55:43.811962 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Mon May 9 22:55:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 22:55:43.822160 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-30f27841-4fce-4240-9291-16eb28d0a590 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:43.835808 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-30f27841-4fce-4240-9291-16eb28d0a590 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017926 May 09 22:55:43.836342 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Mon May 9 22:55:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 22:55:43.845286 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-6c4dc9bd-4e3d-4d9d-a6f8-ac78ed1c129d admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:43.850473 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.wsgi [None req-6c4dc9bd-4e3d-4d9d-a6f8-ac78ed1c129d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-6c4dc9bd-4e3d-4d9d-a6f8-ac78ed1c129d admin admin] Request method failure captured: May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Accept: application/json May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Accept-Encoding: gzip, deflate May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Connection: keep-alive May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Content-Length: 0 May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Host: 10.222.0.23 May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Openstack-Api-Version: compute 2.90 May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Openstack-System-Scope: None May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: User-Agent: python-novaclient May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Auth-Token: gAAAAABieZvvRnAG3zFFRT4-aZ0__sQd5E7JZcF7WBVVkTkUxRo7BOMV1SarhCxdaPkD24jpALo6MCzO2va6za880ZHpA6VJ_AFn9J00TCj-pLimWsrXvBuk0e3yAqDCSS_AUrYD_1fBVLUUjbcAc4lGkNnSnjXz5HZKy_fncpm28EAPxrwSxc4 May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Domain-Id: None May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Domain-Name: None May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Identity-Status: Confirmed May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Is-Admin-Project: True May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Openstack-Nova-Api-Version: 2.90 May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Project-Domain-Id: default May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Project-Domain-Name: Default May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Project-Id: 4202d89a17374bc0a3d992386d254d4c May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Project-Name: admin May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Role: admin,reader,member May 09 22:55:43.851971 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Roles: admin,reader,member May 09 22:55:43.853418 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4202d89a17374bc0a3d992386d254d4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 22:55:43.853418 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Tenant: admin May 09 22:55:43.853418 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Tenant-Id: 4202d89a17374bc0a3d992386d254d4c May 09 22:55:43.853418 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-Tenant-Name: admin May 09 22:55:43.853418 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User: admin May 09 22:55:43.853418 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User-Domain-Id: default May 09 22:55:43.853418 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User-Domain-Name: Default May 09 22:55:43.853418 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User-Id: 873ba60d483a41a4b36c04c1aa8b34ad May 09 22:55:43.853418 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: X-User-Name: admin May 09 22:55:43.853418 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: method: > May 09 22:55:43.853418 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: exception: Flavor 451 could not be found. May 09 22:55:43.853418 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: action_args: {'id': '451'} May 09 22:55:43.853418 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 22:55:43.853418 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 22:55:43.854307 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: ERROR nova.api.openstack.wsgi May 09 22:55:43.855491 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-6c4dc9bd-4e3d-4d9d-a6f8-ac78ed1c129d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 22:55:43.856524 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-6c4dc9bd-4e3d-4d9d-a6f8-ac78ed1c129d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011535 May 09 22:55:43.856524 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Mon May 9 22:55:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 22:55:44.748982 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-30f27841-4fce-4240-9291-16eb28d0a590 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:44.749983 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-30f27841-4fce-4240-9291-16eb28d0a590 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 09 22:55:44.750497 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Mon May 9 22:55:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:44.934788 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-17b6dd8b-9b05-4223-9964-d21520139f77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:44.951804 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-17b6dd8b-9b05-4223-9964-d21520139f77 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.066769 May 09 22:55:44.952349 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Mon May 9 22:55:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 22:55:45.829244 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-30f27841-4fce-4240-9291-16eb28d0a590 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:45.830301 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-30f27841-4fce-4240-9291-16eb28d0a590 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 09 22:55:45.830699 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Mon May 9 22:55:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:46.017457 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-4b5e6d63-df6e-4f9f-8c2a-e39a3e8a687b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:46.034039 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-4b5e6d63-df6e-4f9f-8c2a-e39a3e8a687b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067096 May 09 22:55:46.034605 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Mon May 9 22:55:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 22:55:46.930839 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-30f27841-4fce-4240-9291-16eb28d0a590 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:46.931912 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-30f27841-4fce-4240-9291-16eb28d0a590 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 09 22:55:46.932309 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Mon May 9 22:55:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:47.121376 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-994f6bac-f794-40af-943e-c97235d5412c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:47.138007 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-994f6bac-f794-40af-943e-c97235d5412c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067879 May 09 22:55:47.138591 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Mon May 9 22:55:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 22:55:48.020887 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-30f27841-4fce-4240-9291-16eb28d0a590 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:48.021901 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-30f27841-4fce-4240-9291-16eb28d0a590 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 09 22:55:48.022357 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Mon May 9 22:55:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:48.217780 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-142f62a4-5cf1-4efb-80d9-1b163bc8ea07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 22:55:48.235113 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-142f62a4-5cf1-4efb-80d9-1b163bc8ea07 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069704 May 09 22:55:48.235574 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Mon May 9 22:55:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 22:55:49.127652 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-30f27841-4fce-4240-9291-16eb28d0a590 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:49.128692 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-30f27841-4fce-4240-9291-16eb28d0a590 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 09 22:55:49.129094 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Mon May 9 22:55:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:55:49.317679 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-d050d5c0-ba41-4d60-90d7-d212c28e0d05 admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:55:49.340483 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-d050d5c0-ba41-4d60-90d7-d212c28e0d05 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072440 May 09 22:55:49.341216 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Mon May 9 22:55:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 22:56:51.144765 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-30f27841-4fce-4240-9291-16eb28d0a590 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:56:51.145784 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-30f27841-4fce-4240-9291-16eb28d0a590 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 09 22:56:51.146303 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 930 bytes} [Mon May 9 22:56:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 22:56:51.203851 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-1fca0a42-6750-4a28-b925-48ce5336f025 admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:56:51.223244 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-1fca0a42-6750-4a28-b925-48ce5336f025 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070563 May 09 22:56:51.223777 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1291 bytes} [Mon May 9 22:56:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 22:56:51.247005 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-cf8f3967-27db-48ce-a354-46ad819c1e6e admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:56:51.254529 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-cf8f3967-27db-48ce-a354-46ad819c1e6e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011666 May 09 22:56:51.255049 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1282 bytes} [Mon May 9 22:56:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 22:56:51.265954 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-f31f34d0-e9dd-4a2d-b03a-43e6c194ffd6 admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:56:51.273850 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-f31f34d0-e9dd-4a2d-b03a-43e6c194ffd6 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011415 May 09 22:56:51.274394 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1285 bytes} [Mon May 9 22:56:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 22:56:51.285036 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-fe69b7c5-2d64-4844-bd94-503637a0af22 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:56:51.292910 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-fe69b7c5-2d64-4844-bd94-503637a0af22 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011347 May 09 22:56:51.294413 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1285 bytes} [Mon May 9 22:56:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 22:56:51.304269 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-195402e7-4ff9-4b6f-8cb6-3632edfdd204 admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 22:56:51.311705 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-195402e7-4ff9-4b6f-8cb6-3632edfdd204 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010899 May 09 22:56:51.312219 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1282 bytes} [Mon May 9 22:56:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:00:11.756989 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-fe69b7c5-2d64-4844-bd94-503637a0af22 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:00:11.758009 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-fe69b7c5-2d64-4844-bd94-503637a0af22 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 09 23:00:11.758515 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Mon May 9 23:00:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:00:12.028314 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-bb28e408-c8b6-46b0-b1bf-51c442f0495d admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:00:12.029470 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 23:00:12.029470 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: warnings.warn(msg) May 09 23:00:12.030680 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-bb28e408-c8b6-46b0-b1bf-51c442f0495d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:00:12.031115 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-bb28e408-c8b6-46b0-b1bf-51c442f0495d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:00:12.031896 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-bb28e408-c8b6-46b0-b1bf-51c442f0495d admin admin] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:00:12.032356 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-bb28e408-c8b6-46b0-b1bf-51c442f0495d admin admin] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:00:12.065282 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-bb28e408-c8b6-46b0-b1bf-51c442f0495d admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151617 May 09 23:00:12.065836 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Mon May 9 23:00:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 23:00:12.970227 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-fe69b7c5-2d64-4844-bd94-503637a0af22 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:00:12.971239 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-fe69b7c5-2d64-4844-bd94-503637a0af22 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 09 23:00:12.971635 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Mon May 9 23:00:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:00:13.167754 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-9514f526-392b-47c8-81d2-0c57e1bd5352 admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:00:13.168950 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 23:00:13.168950 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: warnings.warn(msg) May 09 23:00:13.170158 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-9514f526-392b-47c8-81d2-0c57e1bd5352 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:00:13.170609 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-9514f526-392b-47c8-81d2-0c57e1bd5352 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:00:13.171407 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-9514f526-392b-47c8-81d2-0c57e1bd5352 admin admin] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:00:13.171843 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-9514f526-392b-47c8-81d2-0c57e1bd5352 admin admin] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:00:13.191277 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-9514f526-392b-47c8-81d2-0c57e1bd5352 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074035 May 09 23:00:13.191759 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Mon May 9 23:00:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 23:00:24.518443 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-fe69b7c5-2d64-4844-bd94-503637a0af22 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:00:24.519459 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-fe69b7c5-2d64-4844-bd94-503637a0af22 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 09 23:00:24.519857 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Mon May 9 23:00:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:00:24.712066 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-2d11aa43-6eb7-4a4c-ae74-52ad944ae021 admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:00:24.713356 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 23:00:24.713356 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: warnings.warn(msg) May 09 23:00:24.714624 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-2d11aa43-6eb7-4a4c-ae74-52ad944ae021 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:00:24.715075 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-2d11aa43-6eb7-4a4c-ae74-52ad944ae021 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:00:24.715872 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-2d11aa43-6eb7-4a4c-ae74-52ad944ae021 admin admin] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:00:24.716301 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-2d11aa43-6eb7-4a4c-ae74-52ad944ae021 admin admin] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:00:24.742035 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-2d11aa43-6eb7-4a4c-ae74-52ad944ae021 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084684 May 09 23:00:24.742933 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Mon May 9 23:00:24 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:00:25.638312 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-fe69b7c5-2d64-4844-bd94-503637a0af22 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:00:25.639368 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-fe69b7c5-2d64-4844-bd94-503637a0af22 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 May 09 23:00:25.639781 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Mon May 9 23:00:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:00:25.830484 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG nova.api.openstack.wsgi [None req-62ca0ed3-b5ee-4c22-83fa-161927463aa8 admin admin] Calling method '>' {{(pid=102609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:00:25.831650 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 23:00:25.831650 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: warnings.warn(msg) May 09 23:00:25.832836 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-62ca0ed3-b5ee-4c22-83fa-161927463aa8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:00:25.833296 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-62ca0ed3-b5ee-4c22-83fa-161927463aa8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:00:25.834065 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-62ca0ed3-b5ee-4c22-83fa-161927463aa8 admin admin] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:00:25.834549 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: DEBUG oslo_concurrency.lockutils [None req-62ca0ed3-b5ee-4c22-83fa-161927463aa8 admin admin] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:00:25.856707 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: INFO nova.api.openstack.requestlog [None req-62ca0ed3-b5ee-4c22-83fa-161927463aa8 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077148 May 09 23:00:25.857183 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: [pid: 102609|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Mon May 9 23:00:25 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:01:25.593420 dv-cinder-840678-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 09 23:01:25.593983 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: Mon May 9 23:01:25 2022 - graceful shutdown triggered... May 09 23:01:25.594462 dv-cinder-840678-5-iscsi devstack@n-api.service[102609]: Gracefully killing worker 1 (pid: 102609)... May 09 23:01:25.594831 dv-cinder-840678-5-iscsi devstack@n-api.service[102610]: Gracefully killing worker 2 (pid: 102610)... May 09 23:01:26.594228 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: worker 1 buried after 1 seconds May 09 23:01:26.594627 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: worker 2 buried after 1 seconds May 09 23:01:26.594627 dv-cinder-840678-5-iscsi devstack@n-api.service[102608]: goodbye to uWSGI. May 09 23:01:26.595824 dv-cinder-840678-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 09 23:01:26.596915 dv-cinder-840678-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 09 23:01:26.599703 dv-cinder-840678-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 09 23:01:26.618646 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 09 23:01:26.638835 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 23:01:26 2022] *** May 09 23:01:26.638835 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 23:01:26.638835 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 23:01:26.638835 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: nodename: dv-cinder-840678-5-iscsi May 09 23:01:26.638835 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: machine: x86_64 May 09 23:01:26.638835 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: clock source: unix May 09 23:01:26.638835 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: pcre jit disabled May 09 23:01:26.638835 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: detected number of CPU cores: 4 May 09 23:01:26.638835 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: current working directory: / May 09 23:01:26.638835 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: detected binary path: /usr/bin/uwsgi-core May 09 23:01:26.638835 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: your processes number limit is 47680 May 09 23:01:26.639732 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: your memory page size is 4096 bytes May 09 23:01:26.639732 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: detected max file descriptor number: 2048 May 09 23:01:26.639732 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: lock engine: pthread robust mutexes May 09 23:01:26.639732 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: thunder lock: enabled May 09 23:01:26.639732 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 09 23:01:26.639732 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 23:01:26.686353 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: Python main interpreter initialized at 0x561c513ba9c0 May 09 23:01:26.686353 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: python threads support enabled May 09 23:01:26.686353 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: your server socket listen backlog is limited to 100 connections May 09 23:01:26.686353 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: your mercy for graceful operations on workers is 90 seconds May 09 23:01:26.686803 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: mapped 403077 bytes (393 KB) for 2 cores May 09 23:01:26.686803 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: *** Operational MODE: preforking *** May 09 23:01:26.687057 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: *** uWSGI is running in multiple interpreter mode *** May 09 23:01:26.687057 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: spawned uWSGI master process (pid: 117120) May 09 23:01:26.687264 dv-cinder-840678-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 09 23:01:26.688207 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: spawned uWSGI worker 1 (pid: 117142, cores: 1) May 09 23:01:26.688207 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: spawned uWSGI worker 2 (pid: 117143, cores: 1) May 09 23:01:26.688398 dv-cinder-840678-5-iscsi devstack@n-api.service[117120]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 23:01:27.905987 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 23:01:27.911826 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 23:01:28.708439 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 23:01:28.708439 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: from cryptography.utils import int_from_bytes May 09 23:01:28.708763 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 23:01:28.708763 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: from cryptography.utils import int_from_bytes May 09 23:01:28.735290 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 23:01:28.735290 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: from cryptography.utils import int_from_bytes May 09 23:01:28.735602 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 23:01:28.735602 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: from cryptography.utils import int_from_bytes May 09 23:01:31.160107 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 23:01:31.160701 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 23:01:31.161015 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 23:01:31.161289 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 23:01:31.161551 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 23:01:31.161947 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.162309 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.162644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.162972 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.163350 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.163674 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.164242 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.164820 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.165422 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.165841 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.166474 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.166856 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-5-iscsi {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.167201 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.167529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.167856 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.168254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.168837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.169247 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.169573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.170090 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.171533 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.171533 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.175008 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.175008 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.175008 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.175008 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.175008 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.175008 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.175008 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.175542 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.175626 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-5-iscsi {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.175939 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.176268 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.176598 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.177041 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.177372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.177699 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.178035 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.178398 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.178724 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.179358 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.179440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.179706 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.180033 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.180347 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.180673 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.181189 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.181400 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.181690 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.181956 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 23:01:31.182478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.182636 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 23:01:31.182790 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.182946 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 23:01:31.183090 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.183252 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 23:01:31.183404 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 23:01:31.183553 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.183761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.184056 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.184216 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.184400 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.184585 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.184751 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.185041 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.185201 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.185363 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.185507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.185652 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.185803 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.185966 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.186109 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.186319 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.186526 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.186713 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.186872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.187036 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.187188 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-5-iscsi {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.187776 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.187954 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.187954 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.188273 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.188447 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.188624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.188791 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.188946 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.189097 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.189241 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.189394 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.189548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.189699 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.189912 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.190093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.190277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.190446 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.190446 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.190748 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.190893 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.191035 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.191186 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.192872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.193063 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.193219 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.193219 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.193509 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.193653 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.193814 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.194258 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.194418 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.194563 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.194718 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.194892 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-5-iscsi {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.195051 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.195196 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.195334 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.195855 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.195961 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.196048 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.196134 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.196134 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.196282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.196368 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.196461 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.196554 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.196652 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.196743 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.196843 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.196935 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.197026 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.197203 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.197298 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.197459 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.197554 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.197646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.197746 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.197853 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.197947 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.198032 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.198136 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.198897 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.199011 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.199107 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.199193 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.199283 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.199382 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.199480 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.199566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.199650 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.199744 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.199837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.199927 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.200022 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.200113 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.200197 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.200280 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.200369 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.200459 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.200556 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.200649 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.200734 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.200824 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.200962 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.201066 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.201210 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.201317 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.201534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.201681 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.201856 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.202006 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.202235 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.202491 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.202602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.202807 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.202906 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.203122 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.203221 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.203433 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.203547 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.203744 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.203842 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.204055 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.204160 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.204365 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.204475 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.204673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.204779 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.204984 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.205088 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.205300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.205403 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.205651 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.205759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.205961 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.206067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.206313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.206413 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.206625 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.206728 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.206945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.207050 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.207254 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.207351 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.207579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.207713 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.207890 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.208087 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.208259 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.208503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.208609 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.208816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.209114 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.209226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.209430 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.209526 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.209741 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.209847 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.210050 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.210282 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.210448 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.210598 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.210759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.210903 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.211056 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.211215 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.211360 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.211503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.211656 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.211801 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.211953 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.212137 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.212285 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.212435 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.212581 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.212759 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.212921 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.213073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.213246 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.213426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.213584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.213731 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.213911 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.214072 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.214245 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.214470 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.214622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.214778 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.214932 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.215084 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.215228 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.215382 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.215533 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.215685 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.215843 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.215995 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.216146 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.216291 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.216442 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.216601 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.216768 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.216921 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.217065 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.217215 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.217375 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.217529 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.217673 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.217825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.218003 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.218176 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.218337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.218492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.218645 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.218806 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.218962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.219242 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.219397 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.219542 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.219686 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.219828 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.219984 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.220182 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.220334 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.220486 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.220642 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.220813 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.220960 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.221635 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.221797 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.221942 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.222095 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.222293 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.222439 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.222591 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.222807 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.222970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.223125 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.223421 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.223585 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.223738 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.223984 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.224163 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.224316 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.224595 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.224748 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.224901 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.226223 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.226339 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.226430 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.226522 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.226621 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.226867 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.226970 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.227057 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.227150 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.227243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.227343 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.227343 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.227504 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.227596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.227596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 23:01:31.227762 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.227921 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.228256 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.228599 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.228916 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.229179 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.229432 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.229655 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.229914 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.230316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.230520 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.230741 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.230910 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.230910 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.231199 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.231366 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.231366 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.231663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.231823 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.231969 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.232193 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.232193 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.232898 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.233160 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.233410 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.233645 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.233870 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.234033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.234229 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.234388 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.234541 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.234695 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.234840 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.234983 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.235135 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.235289 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.235434 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.235586 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.235739 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.235895 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.235895 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.236189 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.236341 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.236494 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.236494 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.236825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.237477 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.237632 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.237786 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.237931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.237931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.238241 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.238467 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.238633 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.238779 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.238934 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.239089 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.239241 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.239400 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.239553 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.239747 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.239899 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.240043 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.240195 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.240349 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.240495 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.240495 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.240787 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.240940 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.240940 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.241230 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.241383 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.241541 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.241697 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.241848 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.242013 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.242228 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.242381 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.242526 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.242681 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.242826 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.242984 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.243137 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.243290 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.243441 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.243586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.243729 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.243886 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.244040 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.244184 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.244336 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.244481 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.244643 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.244788 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.244931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.245083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.245228 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.245371 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.245532 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.245685 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.245829 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.245973 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.246143 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.246297 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.246297 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.246602 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.246755 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.246900 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.247050 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.247195 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.247352 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.247497 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.247649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.247801 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.247945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.248099 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.248245 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.248405 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.248556 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.248708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.248852 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.249004 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.249148 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.249293 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.249436 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.249589 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.249740 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.249894 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.250047 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.250317 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.250487 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.250641 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.250786 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.250944 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.250944 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.251218 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.251368 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.251519 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.251683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.251829 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.251981 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.252133 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.252284 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.252470 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.252625 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.252769 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.252921 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.253067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.253211 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.253362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.253516 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.253669 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.253821 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.253973 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.254135 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.254307 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.254462 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.254616 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.254767 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.254912 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.255063 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.255215 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.255375 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.255521 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.255666 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.255818 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.255968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.256127 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.256280 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.256450 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.256602 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.256803 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.256954 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.257108 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.257258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.257466 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.257617 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.257802 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.257961 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.258137 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.258300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.258456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.258599 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.258771 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.258923 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.259081 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.259235 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.259404 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.259564 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.259709 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.259868 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.260043 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.260194 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.260368 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.260537 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.260682 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.260837 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.261013 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.261200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.261375 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.261543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.261704 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.261867 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.262020 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.262215 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.262377 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.262523 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.262678 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.262836 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.262990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.263135 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.263287 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.263432 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.263591 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.263735 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.263887 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.264033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.264177 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.264320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.264482 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.264628 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.264797 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.264949 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.265129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.265278 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.265431 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.265576 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.265720 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.265872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.266016 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.266184 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.266353 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.266510 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.266661 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.266806 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.266972 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.267204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.267352 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.267567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.267744 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.267903 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.268113 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.268450 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.268609 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.268763 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.269018 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.269170 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.269389 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.269605 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.269764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.270006 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.270192 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.270346 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.270660 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.270918 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.271166 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.271412 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.271649 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.271910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.272147 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.272327 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.272479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.272632 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.272777 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.272929 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.273088 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.273088 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.273419 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.273566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.273566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.273848 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.274019 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.274224 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.274377 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.274531 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.274676 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.274847 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.275114 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.275348 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.275541 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.275689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.275834 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.275834 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.276143 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.276295 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.276448 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.276593 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.276752 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.276913 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.277064 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.277214 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.277372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.277531 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.277683 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.277848 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.278007 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.278293 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.278461 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.278614 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.278766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.278931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.279090 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.279249 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.279409 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.279575 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.280298 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.280432 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.280537 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.280627 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.280713 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.280812 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.280914 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.281008 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.281101 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.281193 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.281285 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.281369 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.281483 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.281577 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.281677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.281761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.281852 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.281945 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.282039 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.282226 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.282556 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.282670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.282863 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.282957 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.283229 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.283322 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.283531 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.284146 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.284401 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.284499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.284769 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.284862 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.285076 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.285167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.285397 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.285503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.285724 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.285902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.286061 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.286310 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.286466 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.286626 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.286789 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.286941 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.287107 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.287266 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.287417 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.287567 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.287724 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.287883 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.288068 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.288768 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.288945 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.289107 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.289270 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.289435 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.289597 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.289749 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.289900 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.290060 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.290269 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.290360 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.290454 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.290549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.290633 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.290730 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.290730 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.290891 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.290891 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.291034 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.291116 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.291272 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.291379 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.291848 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.291943 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.292183 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.292435 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.292558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.292810 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.292958 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.293131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.293451 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.293551 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.293783 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.293942 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.294129 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.294342 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.294476 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.294669 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.294775 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.295078 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.295168 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.295385 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.295692 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.295808 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.296127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.296327 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.296424 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.296620 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.296821 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.296994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.297153 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.297316 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.297480 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.297735 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.298062 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.298257 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.298423 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.298578 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.298730 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.298882 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.299054 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.299255 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.299919 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.300081 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.300245 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.300431 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.300668 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.300824 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.300824 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.301134 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.301293 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.301445 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.301606 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.301759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.301917 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.302070 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.302279 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.302444 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.302597 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.302757 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.302918 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.303011 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.303105 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.303205 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.303291 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.303375 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.303600 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.303695 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.303993 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.304099 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.304309 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.304409 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.304631 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.304732 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.304945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.305039 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.305273 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.305374 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.305588 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.305724 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.305926 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.306054 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.306286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.306406 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.306559 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.306716 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.306918 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.307083 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.307243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.307395 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.307554 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.307706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.307933 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.308088 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.308239 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.308390 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.308549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.308714 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.308878 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.309051 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.309211 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.309369 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.309527 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.309687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.309839 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.309989 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.310164 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.310324 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.310487 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.310649 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.310810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.310973 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.311132 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.311295 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.311447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.311612 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.311771 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.311931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.312083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.312236 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.312397 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.312549 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.312708 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.312867 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.313030 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.313192 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.313359 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.313512 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.313671 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.313823 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.313823 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.314149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.314328 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.314328 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.314627 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.314808 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.314978 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.315140 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.315318 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.315535 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.315688 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.315847 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.316075 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.316465 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.316748 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.317007 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.317249 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.317508 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.317768 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.317988 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.318195 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.318195 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.318512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.318665 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.318817 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.318983 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.318983 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.319279 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.319431 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.319431 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.319734 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.319895 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.320047 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.320217 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.320377 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.320536 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.320688 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.320688 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.320990 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.321147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.321303 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.321455 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.321614 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.321766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.321923 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.322093 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.322279 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.322443 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.322604 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.322766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.322918 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.323078 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.323230 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.323387 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.323555 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.323714 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.323874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.324026 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.324188 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.324339 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.324499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.324652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.324812 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.324970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.325129 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.325290 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.325443 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.325443 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.325738 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.325738 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.326033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.326239 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.326503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.326672 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.326824 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.326985 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.327145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.327312 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.327472 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.327633 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.327793 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.327946 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.328098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.328263 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.328428 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.328588 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.328740 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.328891 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.329057 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.329216 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.329216 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.329512 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.329675 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.329836 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.329997 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.330203 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.330363 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.330567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.330730 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.330889 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.330889 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.331207 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.331364 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.331514 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.331665 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.331816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.331977 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.332130 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.332288 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.332462 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.332614 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.332778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.332931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.333083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.333235 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.333387 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.333545 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.333706 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.333866 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.334019 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.334192 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.334352 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.334514 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.334514 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.334816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.334968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.335119 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.335119 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.335407 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.335407 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.335708 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.335859 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.335859 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.336147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.336308 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.336489 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.336654 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.336815 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.337009 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.337226 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.337399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.337552 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.337704 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.337989 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.338286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.338553 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.338919 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.339179 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.339438 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.339672 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.339842 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.339997 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.340161 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.340323 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.340475 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.340628 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.340628 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.340628 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.341067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.341219 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.341219 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.341540 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.341732 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.341918 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.342076 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.342249 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.342410 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.342575 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.342729 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.342891 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.343050 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.343209 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.343369 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.343532 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.343692 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.343882 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.344040 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.344201 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.344352 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.344503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.344663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.344847 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.345012 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.345187 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.345347 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.345514 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.345682 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.345835 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.345986 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.346746 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.346869 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.346970 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.347462 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.347574 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.347662 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.347757 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.347854 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.347991 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.348086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.348319 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.348503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.348748 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.348852 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.349065 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.349159 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.349384 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.349502 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.349781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.349891 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.350097 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.350211 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.350439 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.350539 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.350763 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.350863 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.351082 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.351174 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.351406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.351589 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.351742 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.351917 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.352058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.352232 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.352382 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.352558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.352707 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.352885 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.353027 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.353198 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.353346 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.353519 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.353683 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.353845 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.354005 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.354177 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.354336 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.354511 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.354673 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.354832 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.354984 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.355134 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.355286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.355452 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.355608 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.355769 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.355927 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.356079 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.356238 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.356399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.356563 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.356714 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.356903 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.357055 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.357207 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.357637 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.357885 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.358043 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.358239 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.358406 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.358571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.358733 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.358974 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.359146 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.359321 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.359597 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.359804 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.360043 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.360203 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.360398 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.360666 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.360922 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.361222 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.361481 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.361808 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.362077 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.362319 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.362489 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.362661 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.362661 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.362960 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.363120 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.363273 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.363517 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.363517 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.363812 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.363963 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.364114 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.364284 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.364446 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.364599 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.364751 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.364902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.365146 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.365305 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.365470 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.365631 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.365785 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.365948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.366100 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.366313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.366487 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.366640 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.366802 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.366961 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.367121 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.367288 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.367448 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.367600 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.367751 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.367922 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.368094 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.368255 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.368414 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.368586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.368746 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.368906 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.369058 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.369220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.369382 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.369533 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.369684 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.369844 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.369997 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.370180 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.370339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.370500 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.370670 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.370829 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.370990 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.371143 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.371304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.371464 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.371617 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.371776 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.371937 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.372089 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.372248 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.372400 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.372570 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.372730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.372892 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.373053 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.373203 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.373369 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.373521 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.373682 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.373844 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.374004 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.374206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.374374 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.374526 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.374702 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.374863 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.375023 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.375176 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.375334 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.375486 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.375647 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.375807 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.375969 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.376129 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.376283 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.376435 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.376599 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.376762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.376930 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.377089 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.377251 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.377945 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.378134 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.378298 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.378448 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.378599 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.378751 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.378919 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.379079 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.379251 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.379405 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.379557 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.379708 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.379868 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.380027 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.380187 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.380339 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.380492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.380805 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.380978 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.381133 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.381446 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.381607 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.381759 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.382088 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.382326 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.382483 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.382672 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.382845 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.383028 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.383282 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.383534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.383791 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.384049 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.384295 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.384565 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.384773 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.384930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.385083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.385236 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.385236 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.385542 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.385712 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.385712 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.386003 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.386201 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.386201 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.386519 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.386680 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.386833 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.386993 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.387153 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.387315 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.387475 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.387475 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.387782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.387941 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.388109 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.388271 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.388424 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.388575 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.388734 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.388887 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.389053 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.389213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.389373 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.389532 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.389690 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.389850 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.390012 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.390202 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.390553 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.390713 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.390866 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.391016 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.391176 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.391329 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.391480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.391631 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.391810 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.391978 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.392149 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.392325 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.392530 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.392691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.392843 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.393064 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.393306 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.393471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.393624 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.393775 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.393934 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.394096 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.394303 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.394472 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.394644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.394803 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.394963 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.395196 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.395351 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.395503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.395653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.395804 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.395961 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.396127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.396279 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.396438 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.396655 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.396833 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.397018 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.397179 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.397330 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.397481 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.397668 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.397827 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.397988 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.398164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.398346 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.398506 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.398657 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.398818 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.398982 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.399134 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.399294 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.399445 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.399596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.399746 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.399906 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.400065 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.400217 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.400376 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.400528 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.400689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.400857 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.401017 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.401169 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.401321 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.401472 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.401633 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.401785 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.401950 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.402109 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.402307 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.402462 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.402668 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.402828 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.402998 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.403269 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.403429 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.403589 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.403846 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.404029 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.404241 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.404394 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.404547 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.404752 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.404941 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.405156 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.405416 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.405689 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.405934 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.406329 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.406329 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.406745 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.406745 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.407058 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.407058 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.407358 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.407511 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.407511 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.407799 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.407951 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.408121 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.408292 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.408446 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.408627 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.408793 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.408954 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.409117 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.409269 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.409428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.409579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.409737 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.409889 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.410060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.410282 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.410454 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.410614 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.410767 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.410918 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.411078 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.411230 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.411381 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.411540 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.411779 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.411948 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.412110 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.412274 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.412433 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.412584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.412743 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.412904 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.413063 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.413215 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.413366 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.413613 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.413775 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.413937 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.414096 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.414294 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.414468 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.414701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.414861 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.415024 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.415177 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.415327 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.415478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.415667 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.415834 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.416000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.416161 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.416313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.416478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.416629 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.416794 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.416953 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.417106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.417268 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.417420 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.417580 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.417742 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.417894 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.418047 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.418229 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.418382 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.418545 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.418709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.418862 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.419013 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.419174 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.419325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.419490 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.419649 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.419801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.419952 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.420103 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.420254 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.420425 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.420577 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.420728 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.420880 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.421030 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.421181 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.421346 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.421507 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.421667 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.421827 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.421979 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.422166 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.422339 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.422499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.422650 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.422801 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.422959 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.423120 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.423281 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.423434 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.423584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.423743 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.423902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.424071 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.424752 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.424919 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.425127 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.425288 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.425452 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.425770 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.425929 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.426081 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.426422 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.426590 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.426855 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.427049 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.427204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.427403 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.427647 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.427839 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.428341 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.428602 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.428857 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.429105 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.429373 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.429561 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.429726 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.429886 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.430037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.430241 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.430241 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.430549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.430711 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.430711 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.430999 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.431150 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.431150 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.431460 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.431612 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.431773 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.431926 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.432125 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.432463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.432754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.432923 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.433144 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.433304 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.433519 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.433679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.433886 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.434053 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.434313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.434422 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.434538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.434689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.434825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.435088 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.435224 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.435570 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.435683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.435898 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.435993 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.436205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.436299 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.436513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.436615 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.436843 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.436936 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.437182 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.437276 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.437551 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.437668 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.437877 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.437983 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.438217 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.438315 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.438544 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.438716 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.438871 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.439034 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.439188 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.439339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.439500 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.439698 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.439920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.440080 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.440242 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.440448 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.440659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.440869 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.441098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.441334 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.441547 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.441792 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.442029 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.442288 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.442535 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.442766 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.442955 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.443146 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.443146 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.443570 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.443783 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.443998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.444224 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.444224 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.444720 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.444908 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.445072 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.445232 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.445404 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.445557 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.445718 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.445869 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.446036 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.446235 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.446405 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.446576 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.446729 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.446881 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.447034 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.447201 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.447368 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.447530 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.447683 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.447843 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.447995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.448146 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.448307 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.448515 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.448515 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.448826 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.448986 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.448986 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.449291 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.449472 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.449472 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.449817 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.449978 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.450161 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.450322 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.450322 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.450752 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.451023 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.451286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.451540 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.451797 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.452049 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.452215 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.452369 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.452538 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.452701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.452701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 23:01:31.452991 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.452991 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.453429 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.453775 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.454107 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.454529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.454878 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.455215 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.456152 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.456502 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.456846 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.457189 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.457556 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.457889 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.458274 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.458620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.458955 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.459284 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.459603 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 23:01:31.459859 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 23:01:31.478478 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_db.sqlalchemy.engines [None req-cf864715-2ff4-4bb8-99d2-967a90218c45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 23:01:31.486262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_db.sqlalchemy.engines [None req-48ad82ae-f89d-4ce1-80f4-5c9dc5f41e4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 23:01:31.546459 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.context [None req-cf864715-2ff4-4bb8-99d2-967a90218c45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e865ace6-4b09-4716-9268-ae08e665ea6e(cell1) {{(pid=117142) load_cells /opt/stack/nova/nova/context.py:464}} May 09 23:01:31.552027 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf864715-2ff4-4bb8-99d2-967a90218c45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:01:31.553620 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf864715-2ff4-4bb8-99d2-967a90218c45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:01:31.554457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf864715-2ff4-4bb8-99d2-967a90218c45 None None] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:01:31.556415 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf864715-2ff4-4bb8-99d2-967a90218c45 None None] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:01:31.557528 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.context [None req-48ad82ae-f89d-4ce1-80f4-5c9dc5f41e4b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e865ace6-4b09-4716-9268-ae08e665ea6e(cell1) {{(pid=117143) load_cells /opt/stack/nova/nova/context.py:464}} May 09 23:01:31.562308 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-48ad82ae-f89d-4ce1-80f4-5c9dc5f41e4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:01:31.565225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-48ad82ae-f89d-4ce1-80f4-5c9dc5f41e4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:01:31.566450 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-48ad82ae-f89d-4ce1-80f4-5c9dc5f41e4b None None] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:01:31.567862 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_db.sqlalchemy.engines [None req-cf864715-2ff4-4bb8-99d2-967a90218c45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 23:01:31.569141 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-48ad82ae-f89d-4ce1-80f4-5c9dc5f41e4b None None] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:01:31.569569 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_db.sqlalchemy.engines [None req-cf864715-2ff4-4bb8-99d2-967a90218c45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 23:01:31.582187 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_db.sqlalchemy.engines [None req-48ad82ae-f89d-4ce1-80f4-5c9dc5f41e4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 23:01:31.583989 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_db.sqlalchemy.engines [None req-48ad82ae-f89d-4ce1-80f4-5c9dc5f41e4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 23:01:31.741427 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_db.sqlalchemy.engines [None req-cf864715-2ff4-4bb8-99d2-967a90218c45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 23:01:31.765115 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_db.sqlalchemy.engines [None req-48ad82ae-f89d-4ce1-80f4-5c9dc5f41e4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 23:01:32.072209 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: WARNING keystonemiddleware.auth_token [None req-cf864715-2ff4-4bb8-99d2-967a90218c45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 23:01:32.080256 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: WARNING keystonemiddleware.auth_token [None req-cf864715-2ff4-4bb8-99d2-967a90218c45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 23:01:32.107048 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: WARNING keystonemiddleware.auth_token [None req-48ad82ae-f89d-4ce1-80f4-5c9dc5f41e4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 23:01:32.115312 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: WARNING keystonemiddleware.auth_token [None req-48ad82ae-f89d-4ce1-80f4-5c9dc5f41e4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 23:01:32.426304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: WARNING keystonemiddleware.auth_token [None req-cf864715-2ff4-4bb8-99d2-967a90218c45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 23:01:32.432490 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: WARNING keystonemiddleware.auth_token [None req-cf864715-2ff4-4bb8-99d2-967a90218c45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 23:01:32.437798 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561c513ba9c0 pid: 117142 (default app) May 09 23:01:32.466148 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: WARNING keystonemiddleware.auth_token [None req-48ad82ae-f89d-4ce1-80f4-5c9dc5f41e4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 23:01:32.473595 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: WARNING keystonemiddleware.auth_token [None req-48ad82ae-f89d-4ce1-80f4-5c9dc5f41e4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 23:01:32.479059 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561c513ba9c0 pid: 117143 (default app) May 09 23:02:19.355301 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-789148839", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "networks": [{"uuid": "83ac1e51-d1c4-412a-bbb5-5910185182a6"}]}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:02:20.404586 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.network.neutron [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] validate_networks() for [('83ac1e51-d1c4-412a-bbb5-5910185182a6', None, None, None, None, None)] {{(pid=117142) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:02:22.701781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Flavor limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:02:22.702442 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Image limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:02:22.702721 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Flavor pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:02:22.703132 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Image pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:02:22.703541 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:02:22.727501 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:22.727955 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:22.728762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:22.729199 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:22.795438 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Getting quotas for project 0805f702593a4c379db7cdeec818f94b. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:02:22.805073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Getting quotas for user 90018602e07f4a4ca5f46c5c85bc818e and project 0805f702593a4c379db7cdeec818f94b. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:02:22.818992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Going to run 1 instances... {{(pid=117142) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:02:22.822268 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:02:22.945561 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5788092c-de91-4f4e-a55b-3901de2d7f40 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.728412 May 09 23:02:22.957054 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:02:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 4742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:02:23.458380 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6a729b27-ad41-4555-b238-3ebb727c59ed tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:23.460849 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6a729b27-ad41-4555-b238-3ebb727c59ed tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:25.240301 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9e85df35-5c7b-4308-b7d5-7951c5cfef9b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Action: 'create', calling method: .version_select at 0x7fc299912160>, body: {"keypair": {"name": "tempest-keypair-998208448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRWlf71Ec+yF9/JMyigSdayNa8akpWe37+npuqcwHtpSWO3WPQV5eIvyd9ndjoeJQifXl0y/CnmfxKqPxvUI8ChXSdOOdBPkHRjfKmmpa5ryRc3jArMFCketCeFF8amyA=="}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:02:25.303803 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-9e85df35-5c7b-4308-b7d5-7951c5cfef9b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for project b776734a879d4c0785b1d3728b79b766. Resources: {'key_pairs'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:02:25.333256 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-9e85df35-5c7b-4308-b7d5-7951c5cfef9b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for user 84a45506c19c4cda8173c164a097f925 and project b776734a879d4c0785b1d3728b79b766. Resources: {'key_pairs'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:02:25.452167 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9e85df35-5c7b-4308-b7d5-7951c5cfef9b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.698683 May 09 23:02:25.465786 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 2/2] 10.222.0.23 () {60 vars in 1158 bytes} [Mon May 9 23:02:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:02:26.473369 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6a729b27-ad41-4555-b238-3ebb727c59ed tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:26.515295 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6a729b27-ad41-4555-b238-3ebb727c59ed tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1214 microversion: 2.1 time: 3.559538 May 09 23:02:26.515930 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 1/3] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:22 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1214 bytes in 3564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:27.536730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e4f8b532-ec35-4948-a55e-7c2cef478623 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:27.537684 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e4f8b532-ec35-4948-a55e-7c2cef478623 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:27.573801 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e4f8b532-ec35-4948-a55e-7c2cef478623 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:27.574674 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e4f8b532-ec35-4948-a55e-7c2cef478623 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:27.576043 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e4f8b532-ec35-4948-a55e-7c2cef478623 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:27.576614 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e4f8b532-ec35-4948-a55e-7c2cef478623 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:27.964989 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e4f8b532-ec35-4948-a55e-7c2cef478623 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:27.994182 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e4f8b532-ec35-4948-a55e-7c2cef478623 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1284 microversion: 2.1 time: 0.461434 May 09 23:02:27.996483 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:27 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1284 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:29.018341 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-72f5b89c-a527-40a2-a64a-29f2f8bf6401 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:29.020783 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-72f5b89c-a527-40a2-a64a-29f2f8bf6401 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:29.035239 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-72f5b89c-a527-40a2-a64a-29f2f8bf6401 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:29.036522 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-72f5b89c-a527-40a2-a64a-29f2f8bf6401 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:29.041842 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-72f5b89c-a527-40a2-a64a-29f2f8bf6401 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:29.044078 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-72f5b89c-a527-40a2-a64a-29f2f8bf6401 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:29.346848 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-72f5b89c-a527-40a2-a64a-29f2f8bf6401 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:29.370695 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-72f5b89c-a527-40a2-a64a-29f2f8bf6401 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1272 microversion: 2.1 time: 0.361237 May 09 23:02:29.387551 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 2/5] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:29 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1272 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:30.394170 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6af7b8ab-034e-420b-95de-0a5d7b04af7f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:30.394884 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6af7b8ab-034e-420b-95de-0a5d7b04af7f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:30.403775 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6af7b8ab-034e-420b-95de-0a5d7b04af7f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:30.404232 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6af7b8ab-034e-420b-95de-0a5d7b04af7f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:30.405025 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6af7b8ab-034e-420b-95de-0a5d7b04af7f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:30.415014 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6af7b8ab-034e-420b-95de-0a5d7b04af7f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:30.905594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-851476051", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:02:31.028807 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.network.neutron [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] validate_networks() for [('22e6fa81-87ea-460b-b290-1c8d865027a7', None, None, None, None, None)] {{(pid=117142) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:02:31.101937 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6af7b8ab-034e-420b-95de-0a5d7b04af7f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:31.110386 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6af7b8ab-034e-420b-95de-0a5d7b04af7f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.719424 May 09 23:02:31.120618 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 3/6] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:30 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:02:32.137229 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-77b9e20e-bcf2-4dfb-9f18-c6a12642d32e tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:32.138577 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-77b9e20e-bcf2-4dfb-9f18-c6a12642d32e tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:32.148963 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-77b9e20e-bcf2-4dfb-9f18-c6a12642d32e tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:32.151975 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-77b9e20e-bcf2-4dfb-9f18-c6a12642d32e tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:32.155873 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-77b9e20e-bcf2-4dfb-9f18-c6a12642d32e tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:32.161503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-77b9e20e-bcf2-4dfb-9f18-c6a12642d32e tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:32.466319 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Flavor limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:02:32.466909 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Image limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:02:32.467384 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Flavor pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:02:32.467786 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Image pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:02:32.468364 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:02:32.490724 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:32.491580 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:32.512290 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:32.512941 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:32.579822 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Getting quotas for project 0cb055ff9f0d4af6962070c7a2f19bf3. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:02:32.588270 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Getting quotas for user e41b4feaa9be44e89210b70c19ef10ab and project 0cb055ff9f0d4af6962070c7a2f19bf3. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:02:32.632361 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Going to run 1 instances... {{(pid=117142) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:02:32.641700 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:02:32.816529 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-7e073c1e-127b-439c-814f-2cdf96fe9ace tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.041290 May 09 23:02:32.820318 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 4/7] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:02:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 3046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:02:32.840729 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1769409745", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8d1714e-6adf-478e-9341-0aabd043adfd"}], "security_groups": [{"name": "tempest-securitygroup--756008045"}], "key_name": "tempest-keypair-998208448", "user_data": "}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:02:32.889208 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-77b9e20e-bcf2-4dfb-9f18-c6a12642d32e tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:32.898936 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-77b9e20e-bcf2-4dfb-9f18-c6a12642d32e tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.765499 May 09 23:02:32.916881 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:32 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:02:32.929500 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-43215d84-c105-4448-8033-5d070e47379a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:32.948115 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-43215d84-c105-4448-8033-5d070e47379a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:33.168014 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-43215d84-c105-4448-8033-5d070e47379a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:33.175571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-43215d84-c105-4448-8033-5d070e47379a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1221 microversion: 2.1 time: 0.257493 May 09 23:02:33.186417 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 5/9] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:32 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1221 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:33.459166 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.network.neutron [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] validate_networks() for [('a8d1714e-6adf-478e-9341-0aabd043adfd', None, None, None, None, None)] {{(pid=117142) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:02:33.630709 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1367682668", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:02:34.004769 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.network.neutron [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] validate_networks() for [('22e6fa81-87ea-460b-b290-1c8d865027a7', None, None, None, None, None)] {{(pid=117143) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:02:36.700495 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Flavor limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:02:36.701060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Image limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:02:36.702179 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Flavor pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:02:36.703123 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Image pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:02:36.718596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:02:36.740479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:36.741536 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:36.743087 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:36.743690 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:36.873300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for project b776734a879d4c0785b1d3728b79b766. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:02:36.931617 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for user 84a45506c19c4cda8173c164a097f925 and project b776734a879d4c0785b1d3728b79b766. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:02:37.030975 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Going to run 1 instances... {{(pid=117142) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:02:37.039715 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:02:37.224046 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-043d7206-85fb-4715-a363-4d5526b43797 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.402446 May 09 23:02:37.231001 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 5/10] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:02:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 4409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:02:37.247379 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-62f14c9a-8729-477c-85e6-5b3324d0b521 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:37.267960 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-62f14c9a-8729-477c-85e6-5b3324d0b521 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:37.281845 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-62f14c9a-8729-477c-85e6-5b3324d0b521 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:37.285990 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-62f14c9a-8729-477c-85e6-5b3324d0b521 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:37.287086 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-62f14c9a-8729-477c-85e6-5b3324d0b521 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:37.290582 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-62f14c9a-8729-477c-85e6-5b3324d0b521 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:37.638152 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Flavor limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:02:37.639933 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Image limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:02:37.640608 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Flavor pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:02:37.641713 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Image pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:02:37.643311 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:02:37.686291 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:37.689006 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:37.689810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:37.690288 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:37.830542 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Getting quotas for project 0cb055ff9f0d4af6962070c7a2f19bf3. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:02:37.849004 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Getting quotas for user e41b4feaa9be44e89210b70c19ef10ab and project 0cb055ff9f0d4af6962070c7a2f19bf3. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:02:37.896301 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Going to run 1 instances... {{(pid=117143) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:02:37.905850 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:02:38.017801 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-62f14c9a-8729-477c-85e6-5b3324d0b521 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:38.027811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-62f14c9a-8729-477c-85e6-5b3324d0b521 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.795311 May 09 23:02:38.028411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 6/11] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:37 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:38.213206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1c63bd11-f4a5-4e0a-9596-c50e60348ef3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.587907 May 09 23:02:38.214630 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 6/12] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:02:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 4591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:02:38.243371 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-825c3528-80f3-450a-bb3f-15d09148fefe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:38.247104 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-825c3528-80f3-450a-bb3f-15d09148fefe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:38.685361 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-825c3528-80f3-450a-bb3f-15d09148fefe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:38.695147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-825c3528-80f3-450a-bb3f-15d09148fefe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1241 microversion: 2.1 time: 0.475993 May 09 23:02:38.706282 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:38 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1241 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:38.711166 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d8778202-a9e7-4f71-a3ad-bdc66d5a2b49 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:38.715683 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d8778202-a9e7-4f71-a3ad-bdc66d5a2b49 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:38.897179 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-2c921273-3ca0-4101-888c-945bfcd74291 req-80c47154-df96-4636-ae0c-c6d76b4d20a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ed65f5-3706-4a36-8ca4-5e09a2354d07", "tag": "d0f35359-5f2a-472a-967f-5319c7350ff9"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:02:38.919501 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-2c921273-3ca0-4101-888c-945bfcd74291 req-80c47154-df96-4636-ae0c-c6d76b4d20a2 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:38.929703 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-2c921273-3ca0-4101-888c-945bfcd74291 req-80c47154-df96-4636-ae0c-c6d76b4d20a2 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:38.980186 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-2c921273-3ca0-4101-888c-945bfcd74291 req-80c47154-df96-4636-ae0c-c6d76b4d20a2 service nova] Creating event network-changed:d0f35359-5f2a-472a-967f-5319c7350ff9 for instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 on hv-cinder-84067 May 09 23:02:38.981172 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-2c921273-3ca0-4101-888c-945bfcd74291 req-80c47154-df96-4636-ae0c-c6d76b4d20a2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117142) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 09 23:02:38.983396 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4b43e15b-2d46-4fce-861b-8549e8b9c670 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:38.984284 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4b43e15b-2d46-4fce-861b-8549e8b9c670 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:38.986245 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4b43e15b-2d46-4fce-861b-8549e8b9c670 None None] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:38.987082 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4b43e15b-2d46-4fce-861b-8549e8b9c670 None None] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:39.002477 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.compute.rpcapi [None req-4b43e15b-2d46-4fce-861b-8549e8b9c670 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 09 23:02:39.003630 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4b43e15b-2d46-4fce-861b-8549e8b9c670 None None] Releasing lock "compute-rpcapi-router" {{(pid=117142) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 09 23:02:39.055417 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-4b43e15b-2d46-4fce-861b-8549e8b9c670 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.024949 May 09 23:02:39.057161 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 7/14] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:02:39.068838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-40733a21-5ebd-44d0-910a-562bab8df8e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:39.070772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-40733a21-5ebd-44d0-910a-562bab8df8e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:39.110937 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-40733a21-5ebd-44d0-910a-562bab8df8e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:39.114509 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-40733a21-5ebd-44d0-910a-562bab8df8e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:39.119325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-40733a21-5ebd-44d0-910a-562bab8df8e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:39.123279 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-40733a21-5ebd-44d0-910a-562bab8df8e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:39.221893 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d8778202-a9e7-4f71-a3ad-bdc66d5a2b49 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:39.230533 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d8778202-a9e7-4f71-a3ad-bdc66d5a2b49 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1222 microversion: 2.1 time: 0.523086 May 09 23:02:39.244220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 8/15] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:38 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1222 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:39.712743 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2826d08c-c7ec-4d41-98b7-c972ba4cbe8f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:39.718955 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2826d08c-c7ec-4d41-98b7-c972ba4cbe8f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:39.736670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2826d08c-c7ec-4d41-98b7-c972ba4cbe8f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:39.744065 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2826d08c-c7ec-4d41-98b7-c972ba4cbe8f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:39.745447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2826d08c-c7ec-4d41-98b7-c972ba4cbe8f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:39.756908 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2826d08c-c7ec-4d41-98b7-c972ba4cbe8f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:40.009811 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2826d08c-c7ec-4d41-98b7-c972ba4cbe8f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:40.025646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2826d08c-c7ec-4d41-98b7-c972ba4cbe8f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1293 microversion: 2.1 time: 0.308457 May 09 23:02:40.037786 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 9/16] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:39 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1293 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:40.261673 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-621284fa-54cd-4e6e-a939-d19374b9e2e9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:40.272681 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-621284fa-54cd-4e6e-a939-d19374b9e2e9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:40.282073 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-621284fa-54cd-4e6e-a939-d19374b9e2e9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:40.284656 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-621284fa-54cd-4e6e-a939-d19374b9e2e9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:40.286346 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-621284fa-54cd-4e6e-a939-d19374b9e2e9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:40.288028 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-621284fa-54cd-4e6e-a939-d19374b9e2e9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:40.313573 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-40733a21-5ebd-44d0-910a-562bab8df8e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:40.335140 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-40733a21-5ebd-44d0-910a-562bab8df8e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 1.276237 May 09 23:02:40.347776 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 8/17] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:39 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:40.516295 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-621284fa-54cd-4e6e-a939-d19374b9e2e9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:40.525095 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-621284fa-54cd-4e6e-a939-d19374b9e2e9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1274 microversion: 2.1 time: 0.279978 May 09 23:02:40.531115 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 10/18] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:40 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1274 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:02:41.044078 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-bac4cd45-9fac-4ee1-942d-291003041f19 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:41.044988 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-bac4cd45-9fac-4ee1-942d-291003041f19 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:41.057445 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bac4cd45-9fac-4ee1-942d-291003041f19 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:41.058069 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bac4cd45-9fac-4ee1-942d-291003041f19 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:41.059044 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bac4cd45-9fac-4ee1-942d-291003041f19 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:41.060796 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bac4cd45-9fac-4ee1-942d-291003041f19 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:41.358554 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f6553c6c-faf1-4717-980a-37bd8a80afff tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:41.360031 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f6553c6c-faf1-4717-980a-37bd8a80afff tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:41.366980 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f6553c6c-faf1-4717-980a-37bd8a80afff tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:41.367856 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f6553c6c-faf1-4717-980a-37bd8a80afff tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:41.371260 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f6553c6c-faf1-4717-980a-37bd8a80afff tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:41.375345 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f6553c6c-faf1-4717-980a-37bd8a80afff tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:41.485285 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-bac4cd45-9fac-4ee1-942d-291003041f19 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:41.495801 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-bac4cd45-9fac-4ee1-942d-291003041f19 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1299 microversion: 2.1 time: 0.455730 May 09 23:02:41.503607 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 9/19] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:41 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1299 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:41.547980 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-53bdad27-40b6-49a8-94ab-929167d0d23f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:41.548659 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-53bdad27-40b6-49a8-94ab-929167d0d23f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:41.556740 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-53bdad27-40b6-49a8-94ab-929167d0d23f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:41.557243 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-53bdad27-40b6-49a8-94ab-929167d0d23f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:41.575048 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-53bdad27-40b6-49a8-94ab-929167d0d23f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:41.586205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-53bdad27-40b6-49a8-94ab-929167d0d23f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:42.120815 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f6553c6c-faf1-4717-980a-37bd8a80afff tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:42.136788 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f6553c6c-faf1-4717-980a-37bd8a80afff tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.784091 May 09 23:02:42.138165 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 11/20] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:41 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:42.143667 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-55c9240f-6991-40f7-8fb2-9fb7820f8ee1 req-91d9d267-d452-4d7e-99c6-9b892ac636ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7", "tag": "a155ecdb-d89b-4868-8cb1-49548f3d778f"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:02:42.180045 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-55c9240f-6991-40f7-8fb2-9fb7820f8ee1 req-91d9d267-d452-4d7e-99c6-9b892ac636ee service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:42.180674 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-55c9240f-6991-40f7-8fb2-9fb7820f8ee1 req-91d9d267-d452-4d7e-99c6-9b892ac636ee service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:42.229691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-55c9240f-6991-40f7-8fb2-9fb7820f8ee1 req-91d9d267-d452-4d7e-99c6-9b892ac636ee service nova] Creating event network-changed:a155ecdb-d89b-4868-8cb1-49548f3d778f for instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 on hv-cinder-84067 May 09 23:02:42.230867 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-55c9240f-6991-40f7-8fb2-9fb7820f8ee1 req-91d9d267-d452-4d7e-99c6-9b892ac636ee service nova] Acquired lock "compute-rpcapi-router" {{(pid=117143) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 09 23:02:42.232448 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6b266f1a-e10a-4f5f-bc97-861ce956b0a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:42.235259 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6b266f1a-e10a-4f5f-bc97-861ce956b0a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:42.236345 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6b266f1a-e10a-4f5f-bc97-861ce956b0a7 None None] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:42.237263 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6b266f1a-e10a-4f5f-bc97-861ce956b0a7 None None] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:42.262010 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.compute.rpcapi [None req-6b266f1a-e10a-4f5f-bc97-861ce956b0a7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 09 23:02:42.265540 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6b266f1a-e10a-4f5f-bc97-861ce956b0a7 None None] Releasing lock "compute-rpcapi-router" {{(pid=117143) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 09 23:02:42.315647 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6b266f1a-e10a-4f5f-bc97-861ce956b0a7 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175979 May 09 23:02:42.316853 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 12/21] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:02:42.335236 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-53bdad27-40b6-49a8-94ab-929167d0d23f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:42.343063 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-53bdad27-40b6-49a8-94ab-929167d0d23f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1292 microversion: 2.1 time: 0.798949 May 09 23:02:42.348363 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 10/22] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:41 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1292 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:02:42.522009 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7d45f813-4e4d-48c3-a4a3-0618de90da80 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:42.523366 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7d45f813-4e4d-48c3-a4a3-0618de90da80 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:42.542028 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7d45f813-4e4d-48c3-a4a3-0618de90da80 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:42.542584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7d45f813-4e4d-48c3-a4a3-0618de90da80 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:42.543456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7d45f813-4e4d-48c3-a4a3-0618de90da80 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:42.546609 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7d45f813-4e4d-48c3-a4a3-0618de90da80 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:42.889114 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7d45f813-4e4d-48c3-a4a3-0618de90da80 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:42.905892 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7d45f813-4e4d-48c3-a4a3-0618de90da80 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1299 microversion: 2.1 time: 0.388318 May 09 23:02:42.908584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 13/23] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:42 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1299 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:43.157141 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-4b62d075-3dc2-49d5-948a-0f3111ff52f9 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:43.157868 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-4b62d075-3dc2-49d5-948a-0f3111ff52f9 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:43.172859 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4b62d075-3dc2-49d5-948a-0f3111ff52f9 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:43.173369 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4b62d075-3dc2-49d5-948a-0f3111ff52f9 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:43.176686 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4b62d075-3dc2-49d5-948a-0f3111ff52f9 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:43.184159 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4b62d075-3dc2-49d5-948a-0f3111ff52f9 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:43.365448 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f70c7059-118d-44ef-9d05-41c53e80938d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:43.366271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f70c7059-118d-44ef-9d05-41c53e80938d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:43.379241 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f70c7059-118d-44ef-9d05-41c53e80938d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:43.384737 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f70c7059-118d-44ef-9d05-41c53e80938d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:43.385745 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f70c7059-118d-44ef-9d05-41c53e80938d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:43.387682 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f70c7059-118d-44ef-9d05-41c53e80938d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:43.515513 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f70c7059-118d-44ef-9d05-41c53e80938d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:43.523423 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f70c7059-118d-44ef-9d05-41c53e80938d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1280 microversion: 2.1 time: 0.161740 May 09 23:02:43.527179 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 14/24] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:43 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:02:43.894007 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-4b62d075-3dc2-49d5-948a-0f3111ff52f9 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:43.906924 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-4b62d075-3dc2-49d5-948a-0f3111ff52f9 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.755531 May 09 23:02:43.907750 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 11/25] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:43 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:43.925296 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-3818894f-ea8c-45c5-a827-d069cc9ad2f7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:43.926296 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-3818894f-ea8c-45c5-a827-d069cc9ad2f7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:43.944005 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3818894f-ea8c-45c5-a827-d069cc9ad2f7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:43.944474 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3818894f-ea8c-45c5-a827-d069cc9ad2f7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:43.945266 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3818894f-ea8c-45c5-a827-d069cc9ad2f7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:43.945867 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3818894f-ea8c-45c5-a827-d069cc9ad2f7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:44.056828 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3818894f-ea8c-45c5-a827-d069cc9ad2f7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:44.071823 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-3818894f-ea8c-45c5-a827-d069cc9ad2f7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1299 microversion: 2.1 time: 0.149266 May 09 23:02:44.073326 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 15/26] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:43 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:44.544971 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-bfde1e1a-3236-4bf5-b0d0-8e84323a0a31 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:44.546681 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-bfde1e1a-3236-4bf5-b0d0-8e84323a0a31 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:44.556593 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bfde1e1a-3236-4bf5-b0d0-8e84323a0a31 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:44.558381 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bfde1e1a-3236-4bf5-b0d0-8e84323a0a31 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:44.561765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bfde1e1a-3236-4bf5-b0d0-8e84323a0a31 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:44.564362 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bfde1e1a-3236-4bf5-b0d0-8e84323a0a31 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:44.805510 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-bfde1e1a-3236-4bf5-b0d0-8e84323a0a31 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:44.815688 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-bfde1e1a-3236-4bf5-b0d0-8e84323a0a31 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.275583 May 09 23:02:44.816650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 12/27] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:44 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:44.924533 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a97d723b-735a-47e6-a091-83bf299b113b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:44.925738 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a97d723b-735a-47e6-a091-83bf299b113b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:44.935948 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a97d723b-735a-47e6-a091-83bf299b113b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:44.936639 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a97d723b-735a-47e6-a091-83bf299b113b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:44.938394 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a97d723b-735a-47e6-a091-83bf299b113b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:44.939097 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a97d723b-735a-47e6-a091-83bf299b113b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:45.088509 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a97d723b-735a-47e6-a091-83bf299b113b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:45.091055 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-51c36dee-414b-4ee0-9436-1e65467fb260 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:45.091679 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-51c36dee-414b-4ee0-9436-1e65467fb260 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:45.098466 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a97d723b-735a-47e6-a091-83bf299b113b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.176810 May 09 23:02:45.108726 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 16/28] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:44 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:45.108966 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-51c36dee-414b-4ee0-9436-1e65467fb260 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:45.108966 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-51c36dee-414b-4ee0-9436-1e65467fb260 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:45.108966 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-51c36dee-414b-4ee0-9436-1e65467fb260 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:45.108966 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-51c36dee-414b-4ee0-9436-1e65467fb260 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:45.282750 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-51c36dee-414b-4ee0-9436-1e65467fb260 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:45.297721 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-51c36dee-414b-4ee0-9436-1e65467fb260 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.210635 May 09 23:02:45.307958 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 13/29] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:45 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:45.833556 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-10be82a6-195a-4eb9-9d48-1aa131e49b0b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:45.834284 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-10be82a6-195a-4eb9-9d48-1aa131e49b0b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:45.844744 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-10be82a6-195a-4eb9-9d48-1aa131e49b0b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:45.850755 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-10be82a6-195a-4eb9-9d48-1aa131e49b0b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:45.851786 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-10be82a6-195a-4eb9-9d48-1aa131e49b0b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:45.852680 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-10be82a6-195a-4eb9-9d48-1aa131e49b0b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:46.054970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-10be82a6-195a-4eb9-9d48-1aa131e49b0b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:46.065772 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-10be82a6-195a-4eb9-9d48-1aa131e49b0b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.234340 May 09 23:02:46.075391 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 17/30] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:45 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:46.116765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0b3dee4d-027e-4a23-9121-a4dff97673e7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:46.117652 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-0b3dee4d-027e-4a23-9121-a4dff97673e7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:46.133353 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0b3dee4d-027e-4a23-9121-a4dff97673e7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:46.134063 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0b3dee4d-027e-4a23-9121-a4dff97673e7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:46.135054 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0b3dee4d-027e-4a23-9121-a4dff97673e7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:46.135661 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0b3dee4d-027e-4a23-9121-a4dff97673e7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:46.315871 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b356707e-155c-4b67-bf9e-364e9fa80567 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:46.316878 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b356707e-155c-4b67-bf9e-364e9fa80567 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:46.323469 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b356707e-155c-4b67-bf9e-364e9fa80567 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:46.324061 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b356707e-155c-4b67-bf9e-364e9fa80567 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:46.325051 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b356707e-155c-4b67-bf9e-364e9fa80567 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:46.325696 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b356707e-155c-4b67-bf9e-364e9fa80567 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:46.516542 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b356707e-155c-4b67-bf9e-364e9fa80567 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:46.526690 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b356707e-155c-4b67-bf9e-364e9fa80567 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.215240 May 09 23:02:46.527450 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 18/31] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:46 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:02:46.611319 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-0b3dee4d-027e-4a23-9121-a4dff97673e7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:46.619474 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0b3dee4d-027e-4a23-9121-a4dff97673e7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.507054 May 09 23:02:46.620065 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 14/32] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:46 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:46.978385 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-ba2df40c-ee76-4ea7-881e-557c6211c40c req-4fd55b73-6169-450b-b2fa-70f0099abd4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e728c592-21bd-4dc6-a232-66c52c465dec", "tag": "ad371e3b-52c5-4c5f-be12-8b115d8d31ea"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:02:46.986370 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-ba2df40c-ee76-4ea7-881e-557c6211c40c req-4fd55b73-6169-450b-b2fa-70f0099abd4f service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:46.987045 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-ba2df40c-ee76-4ea7-881e-557c6211c40c req-4fd55b73-6169-450b-b2fa-70f0099abd4f service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:46.999291 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-ba2df40c-ee76-4ea7-881e-557c6211c40c req-4fd55b73-6169-450b-b2fa-70f0099abd4f service nova] Creating event network-changed:ad371e3b-52c5-4c5f-be12-8b115d8d31ea for instance e728c592-21bd-4dc6-a232-66c52c465dec on hv-cinder-84067 May 09 23:02:47.004637 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-ba2df40c-ee76-4ea7-881e-557c6211c40c req-4fd55b73-6169-450b-b2fa-70f0099abd4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039876 May 09 23:02:47.005388 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 19/33] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:02:47.084262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ed26bde2-e360-4e1d-ae83-fae096cec962 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:47.085088 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ed26bde2-e360-4e1d-ae83-fae096cec962 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:47.091446 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ed26bde2-e360-4e1d-ae83-fae096cec962 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:47.092009 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ed26bde2-e360-4e1d-ae83-fae096cec962 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:47.092883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ed26bde2-e360-4e1d-ae83-fae096cec962 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:47.093422 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ed26bde2-e360-4e1d-ae83-fae096cec962 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:47.235456 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ed26bde2-e360-4e1d-ae83-fae096cec962 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:47.242790 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ed26bde2-e360-4e1d-ae83-fae096cec962 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.162879 May 09 23:02:47.243300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 15/34] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:47 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:47.543958 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d70c9332-f2fa-4fdc-b454-3630bf4d6e37 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:47.544665 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d70c9332-f2fa-4fdc-b454-3630bf4d6e37 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:47.550743 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d70c9332-f2fa-4fdc-b454-3630bf4d6e37 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:47.551201 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d70c9332-f2fa-4fdc-b454-3630bf4d6e37 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:47.551968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d70c9332-f2fa-4fdc-b454-3630bf4d6e37 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:47.552407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d70c9332-f2fa-4fdc-b454-3630bf4d6e37 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:47.636092 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-b081c396-1baf-4433-8076-7deea1955f56 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:47.636829 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-b081c396-1baf-4433-8076-7deea1955f56 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:47.643951 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b081c396-1baf-4433-8076-7deea1955f56 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:47.644477 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b081c396-1baf-4433-8076-7deea1955f56 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:47.645321 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b081c396-1baf-4433-8076-7deea1955f56 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:47.645844 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b081c396-1baf-4433-8076-7deea1955f56 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:47.677060 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d70c9332-f2fa-4fdc-b454-3630bf4d6e37 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:47.684297 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d70c9332-f2fa-4fdc-b454-3630bf4d6e37 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.144442 May 09 23:02:47.684871 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 20/35] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:47 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:47.770478 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-b081c396-1baf-4433-8076-7deea1955f56 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:47.777605 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-b081c396-1baf-4433-8076-7deea1955f56 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.145310 May 09 23:02:47.778195 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 16/36] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:47 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:02:48.259799 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1b136c1d-179e-41bf-a2f6-55cada4b6a54 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:48.260339 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1b136c1d-179e-41bf-a2f6-55cada4b6a54 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:48.266190 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1b136c1d-179e-41bf-a2f6-55cada4b6a54 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:48.266644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1b136c1d-179e-41bf-a2f6-55cada4b6a54 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:48.267408 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1b136c1d-179e-41bf-a2f6-55cada4b6a54 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:48.267844 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1b136c1d-179e-41bf-a2f6-55cada4b6a54 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:48.391322 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1b136c1d-179e-41bf-a2f6-55cada4b6a54 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:48.398550 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1b136c1d-179e-41bf-a2f6-55cada4b6a54 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.142660 May 09 23:02:48.399096 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 21/37] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:48 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:48.700844 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c18a99f1-27ac-495f-bccd-e1e6c2d28bc8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:48.701473 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c18a99f1-27ac-495f-bccd-e1e6c2d28bc8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:48.707313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c18a99f1-27ac-495f-bccd-e1e6c2d28bc8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:48.707775 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c18a99f1-27ac-495f-bccd-e1e6c2d28bc8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:48.708568 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c18a99f1-27ac-495f-bccd-e1e6c2d28bc8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:48.709004 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c18a99f1-27ac-495f-bccd-e1e6c2d28bc8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:48.794693 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-605a3150-9b5f-494b-8e1d-9902c92f3078 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:48.795962 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-605a3150-9b5f-494b-8e1d-9902c92f3078 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:48.803872 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-605a3150-9b5f-494b-8e1d-9902c92f3078 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:48.804365 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-605a3150-9b5f-494b-8e1d-9902c92f3078 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:48.805820 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-605a3150-9b5f-494b-8e1d-9902c92f3078 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:48.806650 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-605a3150-9b5f-494b-8e1d-9902c92f3078 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:48.839967 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c18a99f1-27ac-495f-bccd-e1e6c2d28bc8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:48.849309 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c18a99f1-27ac-495f-bccd-e1e6c2d28bc8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.151759 May 09 23:02:48.850504 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 17/38] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:48 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:48.940703 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-605a3150-9b5f-494b-8e1d-9902c92f3078 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:48.948143 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-605a3150-9b5f-494b-8e1d-9902c92f3078 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.157423 May 09 23:02:48.948714 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 22/39] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:48 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:49.035579 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-1af1d934-aae7-4b5a-93de-8e082b839029 req-59cfa105-115b-4ca9-99c6-7bb12ad1f156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da290c35-0f36-4420-aaf8-d18fd9b906f0", "tag": "83fd7780-b6ac-4de6-983c-0317e0689d5b"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:02:49.049235 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-1af1d934-aae7-4b5a-93de-8e082b839029 req-59cfa105-115b-4ca9-99c6-7bb12ad1f156 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:49.049755 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-1af1d934-aae7-4b5a-93de-8e082b839029 req-59cfa105-115b-4ca9-99c6-7bb12ad1f156 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:49.062008 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-1af1d934-aae7-4b5a-93de-8e082b839029 req-59cfa105-115b-4ca9-99c6-7bb12ad1f156 service nova] Creating event network-changed:83fd7780-b6ac-4de6-983c-0317e0689d5b for instance da290c35-0f36-4420-aaf8-d18fd9b906f0 on hv-cinder-84067 May 09 23:02:49.067329 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-1af1d934-aae7-4b5a-93de-8e082b839029 req-59cfa105-115b-4ca9-99c6-7bb12ad1f156 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036254 May 09 23:02:49.068014 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 18/40] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:02:49.415526 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-319ddef4-d3b7-4f64-8888-95ec7f812da2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:49.416175 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-319ddef4-d3b7-4f64-8888-95ec7f812da2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:49.422573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-319ddef4-d3b7-4f64-8888-95ec7f812da2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:49.423023 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-319ddef4-d3b7-4f64-8888-95ec7f812da2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:49.423786 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-319ddef4-d3b7-4f64-8888-95ec7f812da2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:49.424222 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-319ddef4-d3b7-4f64-8888-95ec7f812da2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:49.546293 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-319ddef4-d3b7-4f64-8888-95ec7f812da2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:49.553994 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-319ddef4-d3b7-4f64-8888-95ec7f812da2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.142416 May 09 23:02:49.554626 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 23/41] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:49 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:49.868090 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-6a5a22f5-16e2-419c-ac39-06e1e644433d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:49.868799 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-6a5a22f5-16e2-419c-ac39-06e1e644433d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:49.875403 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6a5a22f5-16e2-419c-ac39-06e1e644433d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:49.875861 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6a5a22f5-16e2-419c-ac39-06e1e644433d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:49.876639 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6a5a22f5-16e2-419c-ac39-06e1e644433d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:49.877079 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6a5a22f5-16e2-419c-ac39-06e1e644433d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:49.964530 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f1f54dec-4e50-447b-83a1-791ba8892a0a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:49.965228 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f1f54dec-4e50-447b-83a1-791ba8892a0a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:49.971708 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f1f54dec-4e50-447b-83a1-791ba8892a0a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:49.972158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f1f54dec-4e50-447b-83a1-791ba8892a0a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:49.972929 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f1f54dec-4e50-447b-83a1-791ba8892a0a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:49.973365 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f1f54dec-4e50-447b-83a1-791ba8892a0a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:50.002695 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-6a5a22f5-16e2-419c-ac39-06e1e644433d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:50.009900 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-6a5a22f5-16e2-419c-ac39-06e1e644433d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.145984 May 09 23:02:50.010498 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 19/42] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:49 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:50.101540 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f1f54dec-4e50-447b-83a1-791ba8892a0a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:50.109027 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f1f54dec-4e50-447b-83a1-791ba8892a0a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.148263 May 09 23:02:50.110126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 24/43] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:49 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:02:50.571274 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d61a9cb8-afc4-46e7-ba8c-a56f6faa3c73 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:50.571897 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-d61a9cb8-afc4-46e7-ba8c-a56f6faa3c73 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:50.578587 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d61a9cb8-afc4-46e7-ba8c-a56f6faa3c73 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:50.579096 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d61a9cb8-afc4-46e7-ba8c-a56f6faa3c73 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:50.579873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d61a9cb8-afc4-46e7-ba8c-a56f6faa3c73 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:50.580324 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d61a9cb8-afc4-46e7-ba8c-a56f6faa3c73 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:50.716783 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-d61a9cb8-afc4-46e7-ba8c-a56f6faa3c73 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:50.724084 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d61a9cb8-afc4-46e7-ba8c-a56f6faa3c73 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.156664 May 09 23:02:50.724655 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 20/44] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:50 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:51.027259 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2ef78a4e-2f2d-4c97-a8b0-9d4dc99a58d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:51.027882 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2ef78a4e-2f2d-4c97-a8b0-9d4dc99a58d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:51.033694 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2ef78a4e-2f2d-4c97-a8b0-9d4dc99a58d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:51.034181 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2ef78a4e-2f2d-4c97-a8b0-9d4dc99a58d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:51.034974 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2ef78a4e-2f2d-4c97-a8b0-9d4dc99a58d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:51.035434 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2ef78a4e-2f2d-4c97-a8b0-9d4dc99a58d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:51.126602 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-8f66c297-15be-4a19-8f4c-09bba0b410b7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:51.127222 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-8f66c297-15be-4a19-8f4c-09bba0b410b7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:51.133158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8f66c297-15be-4a19-8f4c-09bba0b410b7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:51.133619 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8f66c297-15be-4a19-8f4c-09bba0b410b7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:51.134421 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8f66c297-15be-4a19-8f4c-09bba0b410b7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:51.135018 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8f66c297-15be-4a19-8f4c-09bba0b410b7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:51.163697 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2ef78a4e-2f2d-4c97-a8b0-9d4dc99a58d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:51.171023 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2ef78a4e-2f2d-4c97-a8b0-9d4dc99a58d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.147622 May 09 23:02:51.172416 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 25/45] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:51 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:51.272854 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-8f66c297-15be-4a19-8f4c-09bba0b410b7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:51.280036 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-8f66c297-15be-4a19-8f4c-09bba0b410b7 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.157827 May 09 23:02:51.280603 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 21/46] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:51 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:02:51.740741 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-156aa2b7-dd77-4cf2-b4ca-cce2b1da64a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:51.741356 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-156aa2b7-dd77-4cf2-b4ca-cce2b1da64a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:51.747333 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-156aa2b7-dd77-4cf2-b4ca-cce2b1da64a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:51.747848 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-156aa2b7-dd77-4cf2-b4ca-cce2b1da64a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:51.748864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-156aa2b7-dd77-4cf2-b4ca-cce2b1da64a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:51.749358 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-156aa2b7-dd77-4cf2-b4ca-cce2b1da64a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:51.915776 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-156aa2b7-dd77-4cf2-b4ca-cce2b1da64a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:51.924248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-156aa2b7-dd77-4cf2-b4ca-cce2b1da64a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.187244 May 09 23:02:51.925615 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 26/47] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:51 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:52.191866 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ff030fe0-b039-4856-a2a4-5de0528e3e88 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:52.192438 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ff030fe0-b039-4856-a2a4-5de0528e3e88 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:52.208638 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ff030fe0-b039-4856-a2a4-5de0528e3e88 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:52.208638 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ff030fe0-b039-4856-a2a4-5de0528e3e88 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:52.209089 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ff030fe0-b039-4856-a2a4-5de0528e3e88 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:52.209373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ff030fe0-b039-4856-a2a4-5de0528e3e88 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:52.299185 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-87329bc0-3024-4a30-81eb-ff85f72a7526 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:52.299798 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-87329bc0-3024-4a30-81eb-ff85f72a7526 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:52.307353 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-87329bc0-3024-4a30-81eb-ff85f72a7526 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:52.307353 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-87329bc0-3024-4a30-81eb-ff85f72a7526 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:52.307529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-87329bc0-3024-4a30-81eb-ff85f72a7526 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:52.307968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-87329bc0-3024-4a30-81eb-ff85f72a7526 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:52.365026 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ff030fe0-b039-4856-a2a4-5de0528e3e88 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:52.376004 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ff030fe0-b039-4856-a2a4-5de0528e3e88 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.191291 May 09 23:02:52.385283 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 22/48] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:52 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:52.453384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-87329bc0-3024-4a30-81eb-ff85f72a7526 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:52.461699 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-87329bc0-3024-4a30-81eb-ff85f72a7526 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.168185 May 09 23:02:52.473967 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 27/49] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:52 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:02:52.943715 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a569e6f5-1b1f-4eb4-ab33-370f9d302c92 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:52.944858 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a569e6f5-1b1f-4eb4-ab33-370f9d302c92 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:52.951432 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a569e6f5-1b1f-4eb4-ab33-370f9d302c92 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:52.952723 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a569e6f5-1b1f-4eb4-ab33-370f9d302c92 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:52.954048 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a569e6f5-1b1f-4eb4-ab33-370f9d302c92 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:52.954549 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a569e6f5-1b1f-4eb4-ab33-370f9d302c92 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:53.075974 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a569e6f5-1b1f-4eb4-ab33-370f9d302c92 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:53.083763 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a569e6f5-1b1f-4eb4-ab33-370f9d302c92 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.145420 May 09 23:02:53.084485 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 23/50] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:52 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:53.392655 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-9cb0e2c8-0c3f-4229-9bb1-ade8dedbdeb5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:53.393272 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-9cb0e2c8-0c3f-4229-9bb1-ade8dedbdeb5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:53.399145 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9cb0e2c8-0c3f-4229-9bb1-ade8dedbdeb5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:53.399601 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9cb0e2c8-0c3f-4229-9bb1-ade8dedbdeb5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:53.400371 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9cb0e2c8-0c3f-4229-9bb1-ade8dedbdeb5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:53.400804 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9cb0e2c8-0c3f-4229-9bb1-ade8dedbdeb5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:53.481178 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c4baa721-c975-49d3-aa82-dc5ba668bd83 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:53.481799 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c4baa721-c975-49d3-aa82-dc5ba668bd83 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:53.488476 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c4baa721-c975-49d3-aa82-dc5ba668bd83 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:53.488931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c4baa721-c975-49d3-aa82-dc5ba668bd83 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:53.489711 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c4baa721-c975-49d3-aa82-dc5ba668bd83 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:53.490172 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c4baa721-c975-49d3-aa82-dc5ba668bd83 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:53.524567 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-9cb0e2c8-0c3f-4229-9bb1-ade8dedbdeb5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:53.532490 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-9cb0e2c8-0c3f-4229-9bb1-ade8dedbdeb5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.143484 May 09 23:02:53.533069 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 28/51] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:53 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:53.616539 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c4baa721-c975-49d3-aa82-dc5ba668bd83 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:53.623863 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c4baa721-c975-49d3-aa82-dc5ba668bd83 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.146474 May 09 23:02:53.624435 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 24/52] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:53 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:02:54.100810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-206bacdd-1910-4f45-9e7d-d2184796950e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:54.101435 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-206bacdd-1910-4f45-9e7d-d2184796950e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:54.107679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-206bacdd-1910-4f45-9e7d-d2184796950e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:54.108134 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-206bacdd-1910-4f45-9e7d-d2184796950e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:54.108904 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-206bacdd-1910-4f45-9e7d-d2184796950e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:54.109342 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-206bacdd-1910-4f45-9e7d-d2184796950e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:54.236045 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-206bacdd-1910-4f45-9e7d-d2184796950e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:54.243201 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-206bacdd-1910-4f45-9e7d-d2184796950e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.146514 May 09 23:02:54.243782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 29/53] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:54 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:54.549456 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-173527d0-1f5c-48be-8eb0-64422d87d534 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:54.550062 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-173527d0-1f5c-48be-8eb0-64422d87d534 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:54.555928 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-173527d0-1f5c-48be-8eb0-64422d87d534 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:54.556370 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-173527d0-1f5c-48be-8eb0-64422d87d534 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:54.557123 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-173527d0-1f5c-48be-8eb0-64422d87d534 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:54.557550 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-173527d0-1f5c-48be-8eb0-64422d87d534 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:54.640349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-860a33d3-039d-4407-8325-824020665bc8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:54.640965 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-860a33d3-039d-4407-8325-824020665bc8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:54.647587 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-860a33d3-039d-4407-8325-824020665bc8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:54.648036 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-860a33d3-039d-4407-8325-824020665bc8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:54.648808 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-860a33d3-039d-4407-8325-824020665bc8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:54.649242 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-860a33d3-039d-4407-8325-824020665bc8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:54.778840 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-860a33d3-039d-4407-8325-824020665bc8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:54.785973 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-860a33d3-039d-4407-8325-824020665bc8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.149420 May 09 23:02:54.786585 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 30/54] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:54 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:02:55.066555 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-173527d0-1f5c-48be-8eb0-64422d87d534 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:55.086749 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-173527d0-1f5c-48be-8eb0-64422d87d534 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.541454 May 09 23:02:55.087425 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 25/55] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:54 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:55.261518 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e04d3b1e-d7f6-425d-af98-f7bf6c513be0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:55.263253 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e04d3b1e-d7f6-425d-af98-f7bf6c513be0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:55.272450 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e04d3b1e-d7f6-425d-af98-f7bf6c513be0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:55.273627 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e04d3b1e-d7f6-425d-af98-f7bf6c513be0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:55.274504 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e04d3b1e-d7f6-425d-af98-f7bf6c513be0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:55.275108 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e04d3b1e-d7f6-425d-af98-f7bf6c513be0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:55.517350 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e04d3b1e-d7f6-425d-af98-f7bf6c513be0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:55.525535 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e04d3b1e-d7f6-425d-af98-f7bf6c513be0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.269338 May 09 23:02:55.526132 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 31/56] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:55 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:55.660075 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-fc59bba7-732b-4a03-9857-1f1aa44097dd req-9c5865d3-fb08-4221-b8a8-d30a056be6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ed65f5-3706-4a36-8ca4-5e09a2354d07", "name": "network-vif-plugged", "status": "completed", "tag": "d0f35359-5f2a-472a-967f-5319c7350ff9"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:02:55.672013 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-fc59bba7-732b-4a03-9857-1f1aa44097dd req-9c5865d3-fb08-4221-b8a8-d30a056be6db service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:55.675439 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-fc59bba7-732b-4a03-9857-1f1aa44097dd req-9c5865d3-fb08-4221-b8a8-d30a056be6db service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:55.690845 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-fc59bba7-732b-4a03-9857-1f1aa44097dd req-9c5865d3-fb08-4221-b8a8-d30a056be6db service nova] Creating event network-vif-plugged:d0f35359-5f2a-472a-967f-5319c7350ff9 for instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 on hv-cinder-84067 May 09 23:02:55.698435 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-fc59bba7-732b-4a03-9857-1f1aa44097dd req-9c5865d3-fb08-4221-b8a8-d30a056be6db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170742 May 09 23:02:55.703389 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 26/57] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:02:55.803598 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-01b5bcf1-00a6-42ae-8a20-2feb1684b878 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:55.804328 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-01b5bcf1-00a6-42ae-8a20-2feb1684b878 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:55.818785 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-01b5bcf1-00a6-42ae-8a20-2feb1684b878 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:55.819362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-01b5bcf1-00a6-42ae-8a20-2feb1684b878 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:55.820228 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-01b5bcf1-00a6-42ae-8a20-2feb1684b878 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:55.822041 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-01b5bcf1-00a6-42ae-8a20-2feb1684b878 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:56.111346 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-48c046ce-7761-4da2-9bc9-b5d3fe396f1e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:56.112543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-48c046ce-7761-4da2-9bc9-b5d3fe396f1e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:56.121404 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-01b5bcf1-00a6-42ae-8a20-2feb1684b878 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:56.130219 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-48c046ce-7761-4da2-9bc9-b5d3fe396f1e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:56.131021 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-01b5bcf1-00a6-42ae-8a20-2feb1684b878 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.331787 May 09 23:02:56.134861 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 32/58] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:55 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:56.136296 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-48c046ce-7761-4da2-9bc9-b5d3fe396f1e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:56.137491 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-48c046ce-7761-4da2-9bc9-b5d3fe396f1e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:56.137945 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-48c046ce-7761-4da2-9bc9-b5d3fe396f1e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:56.378024 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-48c046ce-7761-4da2-9bc9-b5d3fe396f1e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:56.385339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-48c046ce-7761-4da2-9bc9-b5d3fe396f1e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.284349 May 09 23:02:56.386099 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 27/59] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:56 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:56.546898 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c5a436b2-03e8-4c70-8692-7ecdaf8e827b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:56.549514 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c5a436b2-03e8-4c70-8692-7ecdaf8e827b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:56.564880 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c5a436b2-03e8-4c70-8692-7ecdaf8e827b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:56.566511 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c5a436b2-03e8-4c70-8692-7ecdaf8e827b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:56.569413 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c5a436b2-03e8-4c70-8692-7ecdaf8e827b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:56.570469 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c5a436b2-03e8-4c70-8692-7ecdaf8e827b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:56.831441 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c5a436b2-03e8-4c70-8692-7ecdaf8e827b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:56.840450 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c5a436b2-03e8-4c70-8692-7ecdaf8e827b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.300429 May 09 23:02:56.852279 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 33/60] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:56 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:57.148908 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cd2dee91-a959-48d1-b628-6cd662476dfe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:57.150159 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cd2dee91-a959-48d1-b628-6cd662476dfe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:57.156675 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd2dee91-a959-48d1-b628-6cd662476dfe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:57.158184 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd2dee91-a959-48d1-b628-6cd662476dfe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:57.159190 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd2dee91-a959-48d1-b628-6cd662476dfe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:57.160212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd2dee91-a959-48d1-b628-6cd662476dfe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:57.369269 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cd2dee91-a959-48d1-b628-6cd662476dfe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:57.382061 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cd2dee91-a959-48d1-b628-6cd662476dfe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.237546 May 09 23:02:57.383087 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 28/61] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:57 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:57.402199 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-52dc488f-602d-45cd-8e30-0b3ba5b45c70 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:57.403278 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-52dc488f-602d-45cd-8e30-0b3ba5b45c70 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:57.411631 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-52dc488f-602d-45cd-8e30-0b3ba5b45c70 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:57.412106 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-52dc488f-602d-45cd-8e30-0b3ba5b45c70 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:57.413184 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-52dc488f-602d-45cd-8e30-0b3ba5b45c70 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:57.413912 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-52dc488f-602d-45cd-8e30-0b3ba5b45c70 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:57.593911 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-52dc488f-602d-45cd-8e30-0b3ba5b45c70 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:57.603299 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-52dc488f-602d-45cd-8e30-0b3ba5b45c70 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.205611 May 09 23:02:57.604791 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 34/62] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:57 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:57.723071 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-3d94ced2-53e5-4a4c-a457-18485c2d9bac req-0f615ef1-89f9-46df-bc02-b59cbaf157cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7", "name": "network-vif-plugged", "status": "completed", "tag": "a155ecdb-d89b-4868-8cb1-49548f3d778f"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:02:57.738896 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-3d94ced2-53e5-4a4c-a457-18485c2d9bac req-0f615ef1-89f9-46df-bc02-b59cbaf157cf service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:57.741259 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-3d94ced2-53e5-4a4c-a457-18485c2d9bac req-0f615ef1-89f9-46df-bc02-b59cbaf157cf service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:57.759601 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-3d94ced2-53e5-4a4c-a457-18485c2d9bac req-0f615ef1-89f9-46df-bc02-b59cbaf157cf service nova] Creating event network-vif-plugged:a155ecdb-d89b-4868-8cb1-49548f3d778f for instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 on hv-cinder-84067 May 09 23:02:57.765624 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-3d94ced2-53e5-4a4c-a457-18485c2d9bac req-0f615ef1-89f9-46df-bc02-b59cbaf157cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055471 May 09 23:02:57.770190 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 29/63] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:02:57.859181 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-242948f1-b221-49f8-a98e-e81dc9803285 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:57.860349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-242948f1-b221-49f8-a98e-e81dc9803285 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:57.866801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-242948f1-b221-49f8-a98e-e81dc9803285 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:57.867091 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-242948f1-b221-49f8-a98e-e81dc9803285 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:57.868052 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-242948f1-b221-49f8-a98e-e81dc9803285 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:57.868669 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-242948f1-b221-49f8-a98e-e81dc9803285 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:58.105720 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-242948f1-b221-49f8-a98e-e81dc9803285 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:58.117928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-242948f1-b221-49f8-a98e-e81dc9803285 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.260550 May 09 23:02:58.117928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 35/64] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:57 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:58.403624 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cbd5ecde-dd24-442a-bc8d-8610f5f14500 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:58.414755 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cbd5ecde-dd24-442a-bc8d-8610f5f14500 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:58.423552 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cbd5ecde-dd24-442a-bc8d-8610f5f14500 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:58.424638 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cbd5ecde-dd24-442a-bc8d-8610f5f14500 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:58.425959 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cbd5ecde-dd24-442a-bc8d-8610f5f14500 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:58.426771 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cbd5ecde-dd24-442a-bc8d-8610f5f14500 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:58.599221 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cbd5ecde-dd24-442a-bc8d-8610f5f14500 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:58.613345 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cbd5ecde-dd24-442a-bc8d-8610f5f14500 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.213409 May 09 23:02:58.616495 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 30/65] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:58 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:58.625228 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5e581e05-5f52-4065-be8b-af274f1ef89f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:58.625228 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-5e581e05-5f52-4065-be8b-af274f1ef89f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:58.632899 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5e581e05-5f52-4065-be8b-af274f1ef89f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:58.634393 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5e581e05-5f52-4065-be8b-af274f1ef89f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:58.635428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5e581e05-5f52-4065-be8b-af274f1ef89f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:58.639061 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5e581e05-5f52-4065-be8b-af274f1ef89f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:58.796293 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-5e581e05-5f52-4065-be8b-af274f1ef89f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:58.818800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-5e581e05-5f52-4065-be8b-af274f1ef89f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.201569 May 09 23:02:58.834415 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 36/66] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:58 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:02:59.132670 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-8e72a2da-385e-45a1-80fa-3cf1452b12ac tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:59.133294 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-8e72a2da-385e-45a1-80fa-3cf1452b12ac tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:59.143084 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8e72a2da-385e-45a1-80fa-3cf1452b12ac tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:59.143608 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8e72a2da-385e-45a1-80fa-3cf1452b12ac tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:59.144318 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8e72a2da-385e-45a1-80fa-3cf1452b12ac tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:59.144753 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8e72a2da-385e-45a1-80fa-3cf1452b12ac tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:59.311121 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-8e72a2da-385e-45a1-80fa-3cf1452b12ac tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:59.319953 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-8e72a2da-385e-45a1-80fa-3cf1452b12ac tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.191105 May 09 23:02:59.320740 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 31/67] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:59 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:59.634663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ce0ba4bc-dde9-4846-a521-a4fa253ed9cf tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:59.635075 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ce0ba4bc-dde9-4846-a521-a4fa253ed9cf tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:59.642878 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ce0ba4bc-dde9-4846-a521-a4fa253ed9cf tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:59.643478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ce0ba4bc-dde9-4846-a521-a4fa253ed9cf tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:59.644694 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ce0ba4bc-dde9-4846-a521-a4fa253ed9cf tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:59.646042 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ce0ba4bc-dde9-4846-a521-a4fa253ed9cf tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:59.784843 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ce0ba4bc-dde9-4846-a521-a4fa253ed9cf tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:59.793627 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ce0ba4bc-dde9-4846-a521-a4fa253ed9cf tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.163618 May 09 23:02:59.798173 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 37/68] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:59 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:02:59.835624 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-783c2b27-8521-4ab5-a42b-4135622768e3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:02:59.836340 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-783c2b27-8521-4ab5-a42b-4135622768e3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:02:59.842401 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-783c2b27-8521-4ab5-a42b-4135622768e3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:59.842882 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-783c2b27-8521-4ab5-a42b-4135622768e3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:59.843679 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-783c2b27-8521-4ab5-a42b-4135622768e3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:02:59.844143 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-783c2b27-8521-4ab5-a42b-4135622768e3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:02:59.988962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-783c2b27-8521-4ab5-a42b-4135622768e3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:02:59.997061 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-783c2b27-8521-4ab5-a42b-4135622768e3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.165287 May 09 23:02:59.997742 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 32/69] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:02:59 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:00.339282 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-9de59a2d-59c9-4be2-8fc0-914aa46d0415 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:00.340035 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-9de59a2d-59c9-4be2-8fc0-914aa46d0415 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:00.347343 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9de59a2d-59c9-4be2-8fc0-914aa46d0415 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:00.348249 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9de59a2d-59c9-4be2-8fc0-914aa46d0415 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:00.349511 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9de59a2d-59c9-4be2-8fc0-914aa46d0415 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:00.350213 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9de59a2d-59c9-4be2-8fc0-914aa46d0415 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:00.528114 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-9de59a2d-59c9-4be2-8fc0-914aa46d0415 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:00.537715 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-9de59a2d-59c9-4be2-8fc0-914aa46d0415 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.203422 May 09 23:03:00.538329 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 38/70] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:00 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:00.810994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e71bad98-59a5-4c65-aedd-a0561a662570 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:00.812079 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e71bad98-59a5-4c65-aedd-a0561a662570 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:00.818984 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e71bad98-59a5-4c65-aedd-a0561a662570 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:00.819690 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e71bad98-59a5-4c65-aedd-a0561a662570 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:00.820654 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e71bad98-59a5-4c65-aedd-a0561a662570 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:00.821300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e71bad98-59a5-4c65-aedd-a0561a662570 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:00.953513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e71bad98-59a5-4c65-aedd-a0561a662570 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:00.962705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e71bad98-59a5-4c65-aedd-a0561a662570 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.155531 May 09 23:03:00.963398 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 33/71] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:00 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:01.016885 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-24584089-d64e-4834-84e7-e8b0ca5e19aa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:01.017757 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-24584089-d64e-4834-84e7-e8b0ca5e19aa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:01.027591 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-24584089-d64e-4834-84e7-e8b0ca5e19aa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:01.028388 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-24584089-d64e-4834-84e7-e8b0ca5e19aa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:01.029726 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-24584089-d64e-4834-84e7-e8b0ca5e19aa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:01.030198 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-24584089-d64e-4834-84e7-e8b0ca5e19aa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:01.185364 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-24584089-d64e-4834-84e7-e8b0ca5e19aa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:01.192897 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-24584089-d64e-4834-84e7-e8b0ca5e19aa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.181656 May 09 23:03:01.193482 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 39/72] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:01 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:01.555924 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1f0ce0a0-78b9-4a05-9f99-148e514721d5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:01.556541 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1f0ce0a0-78b9-4a05-9f99-148e514721d5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:01.577878 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1f0ce0a0-78b9-4a05-9f99-148e514721d5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:01.578885 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1f0ce0a0-78b9-4a05-9f99-148e514721d5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:01.589864 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1f0ce0a0-78b9-4a05-9f99-148e514721d5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:01.590360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1f0ce0a0-78b9-4a05-9f99-148e514721d5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:01.904305 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1f0ce0a0-78b9-4a05-9f99-148e514721d5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:01.911834 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1f0ce0a0-78b9-4a05-9f99-148e514721d5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.359715 May 09 23:03:01.912404 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 34/73] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:01 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:01.980977 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-59fa3a56-c9c5-480b-898b-cac728129009 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:01.981603 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-59fa3a56-c9c5-480b-898b-cac728129009 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:01.989720 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-59fa3a56-c9c5-480b-898b-cac728129009 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:01.990528 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-59fa3a56-c9c5-480b-898b-cac728129009 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:01.991527 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-59fa3a56-c9c5-480b-898b-cac728129009 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:01.991949 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-59fa3a56-c9c5-480b-898b-cac728129009 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:02.199901 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-59fa3a56-c9c5-480b-898b-cac728129009 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:02.210456 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0120c306-09cd-4795-b970-d92f65afaf5a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:02.211065 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-0120c306-09cd-4795-b970-d92f65afaf5a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:02.212059 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-59fa3a56-c9c5-480b-898b-cac728129009 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.234922 May 09 23:03:02.222554 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0120c306-09cd-4795-b970-d92f65afaf5a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:02.222554 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0120c306-09cd-4795-b970-d92f65afaf5a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:02.222554 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0120c306-09cd-4795-b970-d92f65afaf5a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:02.222554 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0120c306-09cd-4795-b970-d92f65afaf5a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:02.224737 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 40/74] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:01 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:02.355674 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-0120c306-09cd-4795-b970-d92f65afaf5a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:02.363584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0120c306-09cd-4795-b970-d92f65afaf5a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.157866 May 09 23:03:02.364157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 35/75] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:02 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:02.929152 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ae491f7a-ecc8-4e00-a8f7-397fdae8172d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:02.929785 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ae491f7a-ecc8-4e00-a8f7-397fdae8172d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:02.935705 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae491f7a-ecc8-4e00-a8f7-397fdae8172d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:02.936161 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae491f7a-ecc8-4e00-a8f7-397fdae8172d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:02.936933 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae491f7a-ecc8-4e00-a8f7-397fdae8172d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:02.937371 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae491f7a-ecc8-4e00-a8f7-397fdae8172d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:03.062771 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ae491f7a-ecc8-4e00-a8f7-397fdae8172d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:03.070748 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ae491f7a-ecc8-4e00-a8f7-397fdae8172d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.145633 May 09 23:03:03.071331 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 41/76] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:02 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:03.231717 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-667bcf14-6267-44a3-a50e-37347d945ab8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:03.232613 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-667bcf14-6267-44a3-a50e-37347d945ab8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:03.239533 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-667bcf14-6267-44a3-a50e-37347d945ab8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:03.240001 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-667bcf14-6267-44a3-a50e-37347d945ab8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:03.240886 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-667bcf14-6267-44a3-a50e-37347d945ab8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:03.241214 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-667bcf14-6267-44a3-a50e-37347d945ab8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:03.384147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a9c1ee3c-fd24-4d91-8c6d-fa3cfbe0004a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:03.385151 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a9c1ee3c-fd24-4d91-8c6d-fa3cfbe0004a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:03.391585 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a9c1ee3c-fd24-4d91-8c6d-fa3cfbe0004a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:03.392310 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a9c1ee3c-fd24-4d91-8c6d-fa3cfbe0004a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:03.393407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a9c1ee3c-fd24-4d91-8c6d-fa3cfbe0004a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:03.394046 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a9c1ee3c-fd24-4d91-8c6d-fa3cfbe0004a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:03.394500 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-667bcf14-6267-44a3-a50e-37347d945ab8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:03.404337 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-667bcf14-6267-44a3-a50e-37347d945ab8 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.176141 May 09 23:03:03.405587 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 36/77] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:03 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:03.537640 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a9c1ee3c-fd24-4d91-8c6d-fa3cfbe0004a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:03.545393 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a9c1ee3c-fd24-4d91-8c6d-fa3cfbe0004a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.168736 May 09 23:03:03.550163 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 42/78] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:03 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:04.087426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-026d4297-4aad-4ae8-9eaa-a00137326d91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:04.088061 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-026d4297-4aad-4ae8-9eaa-a00137326d91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:04.093871 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-026d4297-4aad-4ae8-9eaa-a00137326d91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:04.094354 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-026d4297-4aad-4ae8-9eaa-a00137326d91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:04.095114 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-026d4297-4aad-4ae8-9eaa-a00137326d91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:04.095548 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-026d4297-4aad-4ae8-9eaa-a00137326d91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:04.218202 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-026d4297-4aad-4ae8-9eaa-a00137326d91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:04.225303 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-026d4297-4aad-4ae8-9eaa-a00137326d91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.141747 May 09 23:03:04.225873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 37/79] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:04 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:04.420787 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ff1d0d1e-cecb-492a-b4f8-38767dfa55e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:04.421358 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ff1d0d1e-cecb-492a-b4f8-38767dfa55e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:04.427766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ff1d0d1e-cecb-492a-b4f8-38767dfa55e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:04.428220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ff1d0d1e-cecb-492a-b4f8-38767dfa55e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:04.428994 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ff1d0d1e-cecb-492a-b4f8-38767dfa55e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:04.429431 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ff1d0d1e-cecb-492a-b4f8-38767dfa55e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:04.554909 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ff1d0d1e-cecb-492a-b4f8-38767dfa55e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:04.561745 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-2e951289-0155-4c17-9e55-bb048fc31400 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:04.562416 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-2e951289-0155-4c17-9e55-bb048fc31400 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:04.563589 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ff1d0d1e-cecb-492a-b4f8-38767dfa55e4 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.146014 May 09 23:03:04.564166 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 43/80] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:04 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:04.569898 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2e951289-0155-4c17-9e55-bb048fc31400 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:04.570389 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2e951289-0155-4c17-9e55-bb048fc31400 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:04.571187 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2e951289-0155-4c17-9e55-bb048fc31400 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:04.571622 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2e951289-0155-4c17-9e55-bb048fc31400 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:04.699500 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-2e951289-0155-4c17-9e55-bb048fc31400 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:04.706682 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-2e951289-0155-4c17-9e55-bb048fc31400 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.148740 May 09 23:03:04.707255 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 38/81] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:04 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:05.242070 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-657f3c4e-d2cf-4d74-8c17-96722bbec05f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:05.242715 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-657f3c4e-d2cf-4d74-8c17-96722bbec05f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:05.248427 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-657f3c4e-d2cf-4d74-8c17-96722bbec05f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:05.248872 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-657f3c4e-d2cf-4d74-8c17-96722bbec05f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:05.249639 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-657f3c4e-d2cf-4d74-8c17-96722bbec05f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:05.250069 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-657f3c4e-d2cf-4d74-8c17-96722bbec05f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:05.380946 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-657f3c4e-d2cf-4d74-8c17-96722bbec05f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:05.388363 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-657f3c4e-d2cf-4d74-8c17-96722bbec05f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.150015 May 09 23:03:05.388880 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 44/82] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:05 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:05.580577 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-282b97a7-5369-4838-b6c0-2a9377332131 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:05.581196 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-282b97a7-5369-4838-b6c0-2a9377332131 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:05.587166 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-282b97a7-5369-4838-b6c0-2a9377332131 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:05.587624 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-282b97a7-5369-4838-b6c0-2a9377332131 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:05.588396 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-282b97a7-5369-4838-b6c0-2a9377332131 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:05.588832 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-282b97a7-5369-4838-b6c0-2a9377332131 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:05.724688 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-882cdf25-be8c-46b2-ace1-a78d7b4ed99d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:05.725901 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-882cdf25-be8c-46b2-ace1-a78d7b4ed99d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:05.731944 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-882cdf25-be8c-46b2-ace1-a78d7b4ed99d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:05.732873 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-882cdf25-be8c-46b2-ace1-a78d7b4ed99d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:05.733849 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-882cdf25-be8c-46b2-ace1-a78d7b4ed99d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:05.734494 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-882cdf25-be8c-46b2-ace1-a78d7b4ed99d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:05.737324 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-282b97a7-5369-4838-b6c0-2a9377332131 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:05.744883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-282b97a7-5369-4838-b6c0-2a9377332131 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.168680 May 09 23:03:05.745741 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 39/83] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:05 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:05.873080 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-882cdf25-be8c-46b2-ace1-a78d7b4ed99d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:05.882163 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-9032fcc3-0cef-48c5-b192-9a42b28d6c78 req-feb0764e-2612-4bd8-b8c9-cdebefb38bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da290c35-0f36-4420-aaf8-d18fd9b906f0", "name": "network-vif-plugged", "status": "completed", "tag": "83fd7780-b6ac-4de6-983c-0317e0689d5b"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:03:05.890372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-882cdf25-be8c-46b2-ace1-a78d7b4ed99d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.169720 May 09 23:03:05.891671 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 45/84] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:05 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:05.892449 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-9032fcc3-0cef-48c5-b192-9a42b28d6c78 req-feb0764e-2612-4bd8-b8c9-cdebefb38bcf service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:05.892896 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-9032fcc3-0cef-48c5-b192-9a42b28d6c78 req-feb0764e-2612-4bd8-b8c9-cdebefb38bcf service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:05.904098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-9032fcc3-0cef-48c5-b192-9a42b28d6c78 req-feb0764e-2612-4bd8-b8c9-cdebefb38bcf service nova] Creating event network-vif-plugged:83fd7780-b6ac-4de6-983c-0317e0689d5b for instance da290c35-0f36-4420-aaf8-d18fd9b906f0 on hv-cinder-84067 May 09 23:03:05.909890 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-9032fcc3-0cef-48c5-b192-9a42b28d6c78 req-feb0764e-2612-4bd8-b8c9-cdebefb38bcf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031942 May 09 23:03:05.910521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 40/85] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:03:06.404757 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-331fed7b-9418-4451-8658-9164e0f2fb2a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:06.405372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-331fed7b-9418-4451-8658-9164e0f2fb2a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:06.411545 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-331fed7b-9418-4451-8658-9164e0f2fb2a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:06.411991 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-331fed7b-9418-4451-8658-9164e0f2fb2a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:06.412831 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-331fed7b-9418-4451-8658-9164e0f2fb2a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:06.413266 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-331fed7b-9418-4451-8658-9164e0f2fb2a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:06.543635 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-331fed7b-9418-4451-8658-9164e0f2fb2a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:06.550806 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-331fed7b-9418-4451-8658-9164e0f2fb2a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.149952 May 09 23:03:06.551378 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 46/86] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:06 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:06.762416 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cf092d2a-1c15-4278-b5f0-c05926555f0d tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:06.763126 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cf092d2a-1c15-4278-b5f0-c05926555f0d tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:06.769042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf092d2a-1c15-4278-b5f0-c05926555f0d tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:06.769497 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf092d2a-1c15-4278-b5f0-c05926555f0d tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:06.770303 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf092d2a-1c15-4278-b5f0-c05926555f0d tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:06.770747 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf092d2a-1c15-4278-b5f0-c05926555f0d tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:06.896897 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cf092d2a-1c15-4278-b5f0-c05926555f0d tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:06.904052 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cf092d2a-1c15-4278-b5f0-c05926555f0d tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.145785 May 09 23:03:06.904620 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 41/87] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:06 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:06.907088 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-474f829a-07c1-4672-bde4-435fd3ebe844 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:06.907710 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-474f829a-07c1-4672-bde4-435fd3ebe844 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:06.913474 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-474f829a-07c1-4672-bde4-435fd3ebe844 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:06.913928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-474f829a-07c1-4672-bde4-435fd3ebe844 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:06.914757 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-474f829a-07c1-4672-bde4-435fd3ebe844 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:06.915198 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-474f829a-07c1-4672-bde4-435fd3ebe844 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:07.036761 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-474f829a-07c1-4672-bde4-435fd3ebe844 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:07.043864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-474f829a-07c1-4672-bde4-435fd3ebe844 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.140635 May 09 23:03:07.044435 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 47/88] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:06 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:07.567283 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f0a8dba0-75f6-42c9-8cda-47bc95bc6af6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:07.567887 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f0a8dba0-75f6-42c9-8cda-47bc95bc6af6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:07.573626 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f0a8dba0-75f6-42c9-8cda-47bc95bc6af6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:07.574068 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f0a8dba0-75f6-42c9-8cda-47bc95bc6af6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:07.574855 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f0a8dba0-75f6-42c9-8cda-47bc95bc6af6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:07.575290 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f0a8dba0-75f6-42c9-8cda-47bc95bc6af6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:07.707636 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f0a8dba0-75f6-42c9-8cda-47bc95bc6af6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:07.714782 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f0a8dba0-75f6-42c9-8cda-47bc95bc6af6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.151356 May 09 23:03:07.715342 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 42/89] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:07 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:07.919761 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-95d3f607-3b0c-4c7c-8d1f-0a3d56a46159 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:07.920408 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-95d3f607-3b0c-4c7c-8d1f-0a3d56a46159 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:07.926276 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-95d3f607-3b0c-4c7c-8d1f-0a3d56a46159 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:07.926740 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-95d3f607-3b0c-4c7c-8d1f-0a3d56a46159 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:07.927517 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-95d3f607-3b0c-4c7c-8d1f-0a3d56a46159 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:07.927962 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-95d3f607-3b0c-4c7c-8d1f-0a3d56a46159 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:08.053561 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-95d3f607-3b0c-4c7c-8d1f-0a3d56a46159 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:08.060516 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a8b2f237-4634-47cf-81d4-b32f0018d65b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:08.060981 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-95d3f607-3b0c-4c7c-8d1f-0a3d56a46159 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1314 microversion: 2.1 time: 0.144857 May 09 23:03:08.061136 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a8b2f237-4634-47cf-81d4-b32f0018d65b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:08.061331 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 48/90] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:07 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:08.067468 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a8b2f237-4634-47cf-81d4-b32f0018d65b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:08.067914 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a8b2f237-4634-47cf-81d4-b32f0018d65b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:08.068677 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a8b2f237-4634-47cf-81d4-b32f0018d65b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:08.069110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a8b2f237-4634-47cf-81d4-b32f0018d65b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:08.194603 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a8b2f237-4634-47cf-81d4-b32f0018d65b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:08.201908 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a8b2f237-4634-47cf-81d4-b32f0018d65b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.144902 May 09 23:03:08.202299 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 43/91] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:08 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:08.740863 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e4b718cd-5a82-41b0-94f3-0f65da05dcc5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:08.741568 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e4b718cd-5a82-41b0-94f3-0f65da05dcc5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:08.747686 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e4b718cd-5a82-41b0-94f3-0f65da05dcc5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:08.748240 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e4b718cd-5a82-41b0-94f3-0f65da05dcc5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:08.749082 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e4b718cd-5a82-41b0-94f3-0f65da05dcc5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:08.749581 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e4b718cd-5a82-41b0-94f3-0f65da05dcc5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:08.892662 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e4b718cd-5a82-41b0-94f3-0f65da05dcc5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:08.911272 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e4b718cd-5a82-41b0-94f3-0f65da05dcc5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.174426 May 09 23:03:08.911891 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 49/92] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:08 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:09.077336 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1cc17c4f-5a50-4d5e-aa34-59155bea2aab tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:09.078129 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1cc17c4f-5a50-4d5e-aa34-59155bea2aab tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:09.087115 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1cc17c4f-5a50-4d5e-aa34-59155bea2aab tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:09.087749 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1cc17c4f-5a50-4d5e-aa34-59155bea2aab tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:09.088974 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1cc17c4f-5a50-4d5e-aa34-59155bea2aab tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:09.089516 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1cc17c4f-5a50-4d5e-aa34-59155bea2aab tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:09.190178 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-d12acbce-b5f1-4166-8222-c9ad8542cb4f req-56909b39-a090-4a8b-940c-605f7d65909d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e728c592-21bd-4dc6-a232-66c52c465dec", "name": "network-vif-plugged", "status": "completed", "tag": "ad371e3b-52c5-4c5f-be12-8b115d8d31ea"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:03:09.199410 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-d12acbce-b5f1-4166-8222-c9ad8542cb4f req-56909b39-a090-4a8b-940c-605f7d65909d service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:09.200015 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-d12acbce-b5f1-4166-8222-c9ad8542cb4f req-56909b39-a090-4a8b-940c-605f7d65909d service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:09.216920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-d12acbce-b5f1-4166-8222-c9ad8542cb4f req-56909b39-a090-4a8b-940c-605f7d65909d service nova] Creating event network-vif-plugged:ad371e3b-52c5-4c5f-be12-8b115d8d31ea for instance e728c592-21bd-4dc6-a232-66c52c465dec on hv-cinder-84067 May 09 23:03:09.223443 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-d12acbce-b5f1-4166-8222-c9ad8542cb4f req-56909b39-a090-4a8b-940c-605f7d65909d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036712 May 09 23:03:09.225042 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 50/93] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:03:09.231401 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-10335811-b57e-4514-986c-f514cdbffa27 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:09.232586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-10335811-b57e-4514-986c-f514cdbffa27 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:09.241466 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-10335811-b57e-4514-986c-f514cdbffa27 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:09.242592 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-10335811-b57e-4514-986c-f514cdbffa27 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:09.243585 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-10335811-b57e-4514-986c-f514cdbffa27 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:09.244634 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-10335811-b57e-4514-986c-f514cdbffa27 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:09.276926 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1cc17c4f-5a50-4d5e-aa34-59155bea2aab tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:09.285674 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1cc17c4f-5a50-4d5e-aa34-59155bea2aab tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1499 microversion: 2.1 time: 0.212192 May 09 23:03:09.286279 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 44/94] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:09 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1499 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:09.391920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-10335811-b57e-4514-986c-f514cdbffa27 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:09.400274 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-10335811-b57e-4514-986c-f514cdbffa27 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.172930 May 09 23:03:09.401343 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 51/95] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:09 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:09.928393 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-753ff363-9300-49d1-819e-657e23cf0343 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:09.929016 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-753ff363-9300-49d1-819e-657e23cf0343 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:09.934792 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-753ff363-9300-49d1-819e-657e23cf0343 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:09.935247 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-753ff363-9300-49d1-819e-657e23cf0343 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:09.936013 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-753ff363-9300-49d1-819e-657e23cf0343 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:09.936449 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-753ff363-9300-49d1-819e-657e23cf0343 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:10.081290 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-753ff363-9300-49d1-819e-657e23cf0343 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:10.088639 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-753ff363-9300-49d1-819e-657e23cf0343 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.163946 May 09 23:03:10.089264 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 45/96] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:09 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:10.417226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2a749dd5-d487-4871-a5af-675a5fae78f2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:10.417844 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2a749dd5-d487-4871-a5af-675a5fae78f2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:10.423894 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2a749dd5-d487-4871-a5af-675a5fae78f2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:10.424349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2a749dd5-d487-4871-a5af-675a5fae78f2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:10.425120 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2a749dd5-d487-4871-a5af-675a5fae78f2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:10.425557 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2a749dd5-d487-4871-a5af-675a5fae78f2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:10.554231 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2a749dd5-d487-4871-a5af-675a5fae78f2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:10.561329 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2a749dd5-d487-4871-a5af-675a5fae78f2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.147960 May 09 23:03:10.561894 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 52/97] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:10 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:11.107017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cb78cc02-0c10-4bda-a3f7-876caff74b6e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:11.107017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cb78cc02-0c10-4bda-a3f7-876caff74b6e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:11.114714 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cb78cc02-0c10-4bda-a3f7-876caff74b6e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:11.115555 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cb78cc02-0c10-4bda-a3f7-876caff74b6e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:11.116536 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cb78cc02-0c10-4bda-a3f7-876caff74b6e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:11.116989 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cb78cc02-0c10-4bda-a3f7-876caff74b6e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:11.245318 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cb78cc02-0c10-4bda-a3f7-876caff74b6e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:11.253067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cb78cc02-0c10-4bda-a3f7-876caff74b6e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.151233 May 09 23:03:11.253631 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 46/98] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:11 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:11.578310 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c3b1942c-c27b-4ca8-915c-23942367ef54 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:11.578921 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c3b1942c-c27b-4ca8-915c-23942367ef54 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:11.584740 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c3b1942c-c27b-4ca8-915c-23942367ef54 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:11.585182 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c3b1942c-c27b-4ca8-915c-23942367ef54 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:11.585936 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c3b1942c-c27b-4ca8-915c-23942367ef54 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:11.586396 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c3b1942c-c27b-4ca8-915c-23942367ef54 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:11.711380 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c3b1942c-c27b-4ca8-915c-23942367ef54 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:11.719238 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c3b1942c-c27b-4ca8-915c-23942367ef54 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.144264 May 09 23:03:11.719824 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 53/99] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:11 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:12.270551 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1905dee0-c567-453b-afee-3564daaa91b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:12.271182 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1905dee0-c567-453b-afee-3564daaa91b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:12.277016 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1905dee0-c567-453b-afee-3564daaa91b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:12.277474 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1905dee0-c567-453b-afee-3564daaa91b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:12.278281 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1905dee0-c567-453b-afee-3564daaa91b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:12.278721 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1905dee0-c567-453b-afee-3564daaa91b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:12.402085 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1905dee0-c567-453b-afee-3564daaa91b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:12.412702 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1905dee0-c567-453b-afee-3564daaa91b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.145646 May 09 23:03:12.412702 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 47/100] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:12 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:12.735988 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0f3b6842-df35-42d6-ae7f-5ed9e78fab60 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:12.736642 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-0f3b6842-df35-42d6-ae7f-5ed9e78fab60 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:12.742517 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0f3b6842-df35-42d6-ae7f-5ed9e78fab60 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:12.742975 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0f3b6842-df35-42d6-ae7f-5ed9e78fab60 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:12.743750 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0f3b6842-df35-42d6-ae7f-5ed9e78fab60 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:12.744188 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0f3b6842-df35-42d6-ae7f-5ed9e78fab60 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:12.891871 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-0f3b6842-df35-42d6-ae7f-5ed9e78fab60 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:12.899162 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-0f3b6842-df35-42d6-ae7f-5ed9e78fab60 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.167727 May 09 23:03:12.899734 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 54/101] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:12 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:13.428711 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-400366c3-bcdc-4bbb-9e24-f7f6db1fdd9b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:13.429319 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-400366c3-bcdc-4bbb-9e24-f7f6db1fdd9b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:13.435164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-400366c3-bcdc-4bbb-9e24-f7f6db1fdd9b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:13.435616 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-400366c3-bcdc-4bbb-9e24-f7f6db1fdd9b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:13.436379 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-400366c3-bcdc-4bbb-9e24-f7f6db1fdd9b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:13.436821 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-400366c3-bcdc-4bbb-9e24-f7f6db1fdd9b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:13.560842 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-400366c3-bcdc-4bbb-9e24-f7f6db1fdd9b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:13.568039 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-400366c3-bcdc-4bbb-9e24-f7f6db1fdd9b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.143148 May 09 23:03:13.568610 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 48/102] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:13 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:13.916926 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ccfe59e9-c4b3-4c2e-9db8-09aadf505a47 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:13.917539 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ccfe59e9-c4b3-4c2e-9db8-09aadf505a47 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:13.923542 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ccfe59e9-c4b3-4c2e-9db8-09aadf505a47 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:13.924027 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ccfe59e9-c4b3-4c2e-9db8-09aadf505a47 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:13.924798 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ccfe59e9-c4b3-4c2e-9db8-09aadf505a47 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:13.925244 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ccfe59e9-c4b3-4c2e-9db8-09aadf505a47 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:14.048723 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ccfe59e9-c4b3-4c2e-9db8-09aadf505a47 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:14.055819 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ccfe59e9-c4b3-4c2e-9db8-09aadf505a47 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.142970 May 09 23:03:14.056392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 55/103] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:13 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:14.584996 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-347ac963-90f1-42d5-83af-527c222128e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:14.585609 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-347ac963-90f1-42d5-83af-527c222128e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:14.591472 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-347ac963-90f1-42d5-83af-527c222128e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:14.591916 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-347ac963-90f1-42d5-83af-527c222128e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:14.592681 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-347ac963-90f1-42d5-83af-527c222128e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:14.593115 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-347ac963-90f1-42d5-83af-527c222128e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:14.723517 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-347ac963-90f1-42d5-83af-527c222128e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:14.730715 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-347ac963-90f1-42d5-83af-527c222128e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.149577 May 09 23:03:14.731281 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 49/104] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:14 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:15.072635 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-456460bf-23d5-458e-a63f-9e1b0fd470ab tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:15.073247 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-456460bf-23d5-458e-a63f-9e1b0fd470ab tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:15.079334 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-456460bf-23d5-458e-a63f-9e1b0fd470ab tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:15.079794 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-456460bf-23d5-458e-a63f-9e1b0fd470ab tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:15.080577 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-456460bf-23d5-458e-a63f-9e1b0fd470ab tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:15.081018 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-456460bf-23d5-458e-a63f-9e1b0fd470ab tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:15.210198 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-456460bf-23d5-458e-a63f-9e1b0fd470ab tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:15.217465 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-456460bf-23d5-458e-a63f-9e1b0fd470ab tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.148650 May 09 23:03:15.217964 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 56/105] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:15 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:15.747528 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ead93acb-93d5-4490-9c35-3a0913a32396 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:15.748148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ead93acb-93d5-4490-9c35-3a0913a32396 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:15.754709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ead93acb-93d5-4490-9c35-3a0913a32396 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:15.755161 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ead93acb-93d5-4490-9c35-3a0913a32396 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:15.755935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ead93acb-93d5-4490-9c35-3a0913a32396 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:15.756377 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ead93acb-93d5-4490-9c35-3a0913a32396 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:15.880983 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ead93acb-93d5-4490-9c35-3a0913a32396 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:15.888080 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ead93acb-93d5-4490-9c35-3a0913a32396 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.144387 May 09 23:03:15.888654 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 50/106] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:15 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:15.993223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-dba7d50f-cefa-4246-897b-4a7466a65177 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a38753e1-d6be-4ceb-a67d-74ae51a03c39"}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:03:15.994717 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-dba7d50f-cefa-4246-897b-4a7466a65177 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:16.000957 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dba7d50f-cefa-4246-897b-4a7466a65177 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:16.001408 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dba7d50f-cefa-4246-897b-4a7466a65177 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:16.002205 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dba7d50f-cefa-4246-897b-4a7466a65177 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:16.002644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dba7d50f-cefa-4246-897b-4a7466a65177 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:16.234785 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e2785caa-59e7-4365-959a-879118badb8e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:16.235401 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e2785caa-59e7-4365-959a-879118badb8e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:16.241128 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e2785caa-59e7-4365-959a-879118badb8e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:16.241590 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e2785caa-59e7-4365-959a-879118badb8e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:16.242394 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e2785caa-59e7-4365-959a-879118badb8e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:16.242837 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e2785caa-59e7-4365-959a-879118badb8e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:16.383396 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e2785caa-59e7-4365-959a-879118badb8e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:16.390641 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e2785caa-59e7-4365-959a-879118badb8e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.159956 May 09 23:03:16.391224 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 51/107] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:16 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:16.904780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-2a5b80ae-7721-438c-88cb-d523bb41ac46 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:16.905404 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-2a5b80ae-7721-438c-88cb-d523bb41ac46 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:16.911674 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2a5b80ae-7721-438c-88cb-d523bb41ac46 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:16.912127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2a5b80ae-7721-438c-88cb-d523bb41ac46 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:16.912891 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2a5b80ae-7721-438c-88cb-d523bb41ac46 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:16.913336 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2a5b80ae-7721-438c-88cb-d523bb41ac46 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:17.037207 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-2a5b80ae-7721-438c-88cb-d523bb41ac46 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:17.044301 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-2a5b80ae-7721-438c-88cb-d523bb41ac46 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.143426 May 09 23:03:17.044953 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 52/108] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:16 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:17.407670 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-780550f5-48eb-462d-89ff-446e840e3384 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:17.408281 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-780550f5-48eb-462d-89ff-446e840e3384 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:17.414022 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-780550f5-48eb-462d-89ff-446e840e3384 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:17.414621 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-780550f5-48eb-462d-89ff-446e840e3384 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:17.415387 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-780550f5-48eb-462d-89ff-446e840e3384 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:17.415817 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-780550f5-48eb-462d-89ff-446e840e3384 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:17.538978 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-780550f5-48eb-462d-89ff-446e840e3384 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:17.546028 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-780550f5-48eb-462d-89ff-446e840e3384 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1366 microversion: 2.1 time: 0.142641 May 09 23:03:17.546622 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 53/109] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:17 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:18.061470 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-50ae2ca5-c77c-4931-919f-ddf15b9fc116 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:18.062092 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-50ae2ca5-c77c-4931-919f-ddf15b9fc116 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:18.068572 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-50ae2ca5-c77c-4931-919f-ddf15b9fc116 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:18.069020 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-50ae2ca5-c77c-4931-919f-ddf15b9fc116 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:18.069792 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-50ae2ca5-c77c-4931-919f-ddf15b9fc116 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:18.070262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-50ae2ca5-c77c-4931-919f-ddf15b9fc116 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:18.198851 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-50ae2ca5-c77c-4931-919f-ddf15b9fc116 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:18.206109 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-50ae2ca5-c77c-4931-919f-ddf15b9fc116 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.148463 May 09 23:03:18.206707 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 54/110] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:18 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:18.562984 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f29ca83d-e81f-4471-925e-d953b9d81bef tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:18.563600 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f29ca83d-e81f-4471-925e-d953b9d81bef tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:18.569315 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f29ca83d-e81f-4471-925e-d953b9d81bef tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:18.569724 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f29ca83d-e81f-4471-925e-d953b9d81bef tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:18.570504 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f29ca83d-e81f-4471-925e-d953b9d81bef tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:18.570931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f29ca83d-e81f-4471-925e-d953b9d81bef tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:18.698843 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f29ca83d-e81f-4471-925e-d953b9d81bef tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:18.707275 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f29ca83d-e81f-4471-925e-d953b9d81bef tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1557 microversion: 2.1 time: 0.148051 May 09 23:03:18.707847 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 55/111] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:18 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:18.724905 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9974e4a8-2184-40bd-926e-5aeca05304b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:18.725389 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9974e4a8-2184-40bd-926e-5aeca05304b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:18.732751 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9974e4a8-2184-40bd-926e-5aeca05304b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:18.733212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9974e4a8-2184-40bd-926e-5aeca05304b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:18.734571 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9974e4a8-2184-40bd-926e-5aeca05304b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:18.735461 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9974e4a8-2184-40bd-926e-5aeca05304b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:18.861476 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9974e4a8-2184-40bd-926e-5aeca05304b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140228 May 09 23:03:18.862140 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 56/112] 10.222.0.23 () {58 vars in 1274 bytes} [Mon May 9 23:03:18 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:03:19.226560 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-b80096e6-2906-4273-8db0-84398d04c936 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:19.227200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-b80096e6-2906-4273-8db0-84398d04c936 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:19.240457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b80096e6-2906-4273-8db0-84398d04c936 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:19.240897 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b80096e6-2906-4273-8db0-84398d04c936 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:19.241693 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b80096e6-2906-4273-8db0-84398d04c936 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:19.242153 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b80096e6-2906-4273-8db0-84398d04c936 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:19.678500 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-b80096e6-2906-4273-8db0-84398d04c936 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:19.689699 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-b80096e6-2906-4273-8db0-84398d04c936 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1322 microversion: 2.1 time: 0.468780 May 09 23:03:19.690530 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 57/113] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:19 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:19.725569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-dba7d50f-cefa-4246-897b-4a7466a65177 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "POST /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.735838 May 09 23:03:19.726848 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 57/114] 10.222.0.23 () {60 vars in 1322 bytes} [Mon May 9 23:03:15 2022] POST /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07/os-volume_attachments => generated 194 bytes in 3738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:03:20.708618 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9348749d-0f3e-4e60-815a-946e9ba2c973 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:20.709689 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9348749d-0f3e-4e60-815a-946e9ba2c973 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:20.716336 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9348749d-0f3e-4e60-815a-946e9ba2c973 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:20.716963 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9348749d-0f3e-4e60-815a-946e9ba2c973 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:20.717900 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9348749d-0f3e-4e60-815a-946e9ba2c973 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:20.718623 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9348749d-0f3e-4e60-815a-946e9ba2c973 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:20.753062 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-fc6a1371-52e9-49b6-bfb2-b9da7f90ee7b req-70921926-e1a6-41f9-af41-7211639e0eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da290c35-0f36-4420-aaf8-d18fd9b906f0", "tag": "83fd7780-b6ac-4de6-983c-0317e0689d5b"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:03:20.765537 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-fc6a1371-52e9-49b6-bfb2-b9da7f90ee7b req-70921926-e1a6-41f9-af41-7211639e0eb6 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:20.772159 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-fc6a1371-52e9-49b6-bfb2-b9da7f90ee7b req-70921926-e1a6-41f9-af41-7211639e0eb6 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:20.787416 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-fc6a1371-52e9-49b6-bfb2-b9da7f90ee7b req-70921926-e1a6-41f9-af41-7211639e0eb6 service nova] Creating event network-changed:83fd7780-b6ac-4de6-983c-0317e0689d5b for instance da290c35-0f36-4420-aaf8-d18fd9b906f0 on hv-cinder-84067 May 09 23:03:20.792705 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-fc6a1371-52e9-49b6-bfb2-b9da7f90ee7b req-70921926-e1a6-41f9-af41-7211639e0eb6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044814 May 09 23:03:20.794215 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 58/115] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:03:21.170556 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-9348749d-0f3e-4e60-815a-946e9ba2c973 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:21.187291 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9348749d-0f3e-4e60-815a-946e9ba2c973 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1517 microversion: 2.1 time: 0.480468 May 09 23:03:21.188719 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 58/116] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:20 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1517 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:21.208449 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-23d0eec9-8367-4718-a8e3-339a493adce5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:03:21.209094 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-23d0eec9-8367-4718-a8e3-339a493adce5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:21.223222 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-23d0eec9-8367-4718-a8e3-339a493adce5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:21.224084 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-23d0eec9-8367-4718-a8e3-339a493adce5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:21.225005 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-23d0eec9-8367-4718-a8e3-339a493adce5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:21.225460 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-23d0eec9-8367-4718-a8e3-339a493adce5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:21.252401 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.objects.instance [None req-23d0eec9-8367-4718-a8e3-339a493adce5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lazy-loading 'flavor' on Instance uuid e728c592-21bd-4dc6-a232-66c52c465dec {{(pid=117143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:03:21.532719 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-23d0eec9-8367-4718-a8e3-339a493adce5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "POST /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec/action" status: 200 len: 32 microversion: 2.1 time: 0.326982 May 09 23:03:21.534980 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 59/117] 10.222.0.23 () {60 vars in 1277 bytes} [Mon May 9 23:03:21 2022] POST /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec/action => generated 32 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 23:03:21.543964 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1fb6db51-caa2-4432-88ba-c8e785cee2ca tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:21.544812 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1fb6db51-caa2-4432-88ba-c8e785cee2ca tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:21.560481 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1fb6db51-caa2-4432-88ba-c8e785cee2ca tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:21.561361 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1fb6db51-caa2-4432-88ba-c8e785cee2ca tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:21.562382 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1fb6db51-caa2-4432-88ba-c8e785cee2ca tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:21.564202 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1fb6db51-caa2-4432-88ba-c8e785cee2ca tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:21.910991 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1fb6db51-caa2-4432-88ba-c8e785cee2ca tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:21.930364 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1fb6db51-caa2-4432-88ba-c8e785cee2ca tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.379943 May 09 23:03:21.930364 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 59/118] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:21 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:22.942516 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-69c40b73-bcac-45a8-a018-f17c62cea3e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:22.943387 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-69c40b73-bcac-45a8-a018-f17c62cea3e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:22.950352 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-69c40b73-bcac-45a8-a018-f17c62cea3e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:22.951050 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-69c40b73-bcac-45a8-a018-f17c62cea3e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:22.951851 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-69c40b73-bcac-45a8-a018-f17c62cea3e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:22.952448 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-69c40b73-bcac-45a8-a018-f17c62cea3e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:23.156644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-69c40b73-bcac-45a8-a018-f17c62cea3e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:23.165385 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-69c40b73-bcac-45a8-a018-f17c62cea3e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.228238 May 09 23:03:23.166189 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 60/119] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:22 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:24.183336 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-575a2057-f58d-4436-be2f-60011289e032 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:24.184720 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-575a2057-f58d-4436-be2f-60011289e032 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:24.199587 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-575a2057-f58d-4436-be2f-60011289e032 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:24.200045 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-575a2057-f58d-4436-be2f-60011289e032 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:24.201002 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-575a2057-f58d-4436-be2f-60011289e032 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:24.202010 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-575a2057-f58d-4436-be2f-60011289e032 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:24.364494 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-575a2057-f58d-4436-be2f-60011289e032 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:24.373828 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-575a2057-f58d-4436-be2f-60011289e032 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.194473 May 09 23:03:24.376697 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 60/120] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:24 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:25.394266 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a9bcbadb-595b-43ff-8b10-e10cd12c96ec tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:25.394982 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a9bcbadb-595b-43ff-8b10-e10cd12c96ec tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:25.403390 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a9bcbadb-595b-43ff-8b10-e10cd12c96ec tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:25.403857 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a9bcbadb-595b-43ff-8b10-e10cd12c96ec tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:25.404833 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a9bcbadb-595b-43ff-8b10-e10cd12c96ec tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:25.405346 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a9bcbadb-595b-43ff-8b10-e10cd12c96ec tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:25.561219 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a9bcbadb-595b-43ff-8b10-e10cd12c96ec tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:25.568396 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a9bcbadb-595b-43ff-8b10-e10cd12c96ec tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.178827 May 09 23:03:25.569721 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 61/121] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:25 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:26.587300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-b765af0b-c173-4cc0-bc8b-fd7ea370e96f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:26.588810 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-b765af0b-c173-4cc0-bc8b-fd7ea370e96f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:26.595772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b765af0b-c173-4cc0-bc8b-fd7ea370e96f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:26.596308 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b765af0b-c173-4cc0-bc8b-fd7ea370e96f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:26.597098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b765af0b-c173-4cc0-bc8b-fd7ea370e96f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:26.598146 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b765af0b-c173-4cc0-bc8b-fd7ea370e96f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:26.773320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-b765af0b-c173-4cc0-bc8b-fd7ea370e96f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:26.782016 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-b765af0b-c173-4cc0-bc8b-fd7ea370e96f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.198996 May 09 23:03:26.782969 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 61/122] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:26 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:27.800225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-886a5e42-ff45-49e6-ab1f-b6d9775ded39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:27.800842 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-886a5e42-ff45-49e6-ab1f-b6d9775ded39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:27.807318 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-886a5e42-ff45-49e6-ab1f-b6d9775ded39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:27.808159 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-886a5e42-ff45-49e6-ab1f-b6d9775ded39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:27.808939 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-886a5e42-ff45-49e6-ab1f-b6d9775ded39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:27.809574 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-886a5e42-ff45-49e6-ab1f-b6d9775ded39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:27.987360 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-886a5e42-ff45-49e6-ab1f-b6d9775ded39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:27.995693 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-886a5e42-ff45-49e6-ab1f-b6d9775ded39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.200002 May 09 23:03:27.996290 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 62/123] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:27 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:29.013787 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-318066d8-3a52-4c7b-922a-37b4e4b4adea tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:29.015319 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-318066d8-3a52-4c7b-922a-37b4e4b4adea tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:29.021612 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-318066d8-3a52-4c7b-922a-37b4e4b4adea tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:29.022071 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-318066d8-3a52-4c7b-922a-37b4e4b4adea tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:29.022890 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-318066d8-3a52-4c7b-922a-37b4e4b4adea tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:29.023334 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-318066d8-3a52-4c7b-922a-37b4e4b4adea tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:29.181020 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-318066d8-3a52-4c7b-922a-37b4e4b4adea tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:29.193891 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-318066d8-3a52-4c7b-922a-37b4e4b4adea tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.183686 May 09 23:03:29.194534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 62/124] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:29 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:29.751291 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-09481816-a99a-441c-812f-e251e9ce2c94 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:29.752989 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-09481816-a99a-441c-812f-e251e9ce2c94 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:29.762875 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-09481816-a99a-441c-812f-e251e9ce2c94 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:29.763340 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-09481816-a99a-441c-812f-e251e9ce2c94 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:29.764294 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-09481816-a99a-441c-812f-e251e9ce2c94 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:29.765282 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-09481816-a99a-441c-812f-e251e9ce2c94 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:29.796158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-09481816-a99a-441c-812f-e251e9ce2c94 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Going to try to terminate instance {{(pid=117143) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:03:29.920509 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-09481816-a99a-441c-812f-e251e9ce2c94 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 204 len: 0 microversion: 2.1 time: 0.175778 May 09 23:03:29.924337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 63/125] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:03:29 2022] DELETE /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:03:29.936008 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-300b784d-08ca-4756-800b-0248573ad0cc tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:29.936942 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-300b784d-08ca-4756-800b-0248573ad0cc tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:29.947729 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-300b784d-08ca-4756-800b-0248573ad0cc tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:29.948454 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-300b784d-08ca-4756-800b-0248573ad0cc tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:29.950736 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-300b784d-08ca-4756-800b-0248573ad0cc tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:29.951256 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-300b784d-08ca-4756-800b-0248573ad0cc tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:30.155899 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-300b784d-08ca-4756-800b-0248573ad0cc tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:30.166431 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-300b784d-08ca-4756-800b-0248573ad0cc tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1551 microversion: 2.1 time: 0.240392 May 09 23:03:30.169173 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 63/126] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:29 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1551 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:30.211694 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-816c25aa-c91b-4c72-9714-a661354d9bb7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:30.212412 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-816c25aa-c91b-4c72-9714-a661354d9bb7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:30.223418 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-816c25aa-c91b-4c72-9714-a661354d9bb7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:30.224074 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-816c25aa-c91b-4c72-9714-a661354d9bb7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:30.225219 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-816c25aa-c91b-4c72-9714-a661354d9bb7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:30.225862 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-816c25aa-c91b-4c72-9714-a661354d9bb7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:30.376118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-816c25aa-c91b-4c72-9714-a661354d9bb7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:30.385125 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-816c25aa-c91b-4c72-9714-a661354d9bb7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.177638 May 09 23:03:30.386717 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 64/127] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:30 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:31.187375 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c83eed0b-35e0-431c-b4f8-c253bb78191b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:31.187978 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c83eed0b-35e0-431c-b4f8-c253bb78191b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:31.194045 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c83eed0b-35e0-431c-b4f8-c253bb78191b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:31.194699 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c83eed0b-35e0-431c-b4f8-c253bb78191b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:31.195717 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c83eed0b-35e0-431c-b4f8-c253bb78191b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:31.196386 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c83eed0b-35e0-431c-b4f8-c253bb78191b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:31.346499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c83eed0b-35e0-431c-b4f8-c253bb78191b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:31.355710 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c83eed0b-35e0-431c-b4f8-c253bb78191b tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1551 microversion: 2.1 time: 0.173363 May 09 23:03:31.356304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 64/128] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:31 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1551 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:31.402540 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c4b1d82a-1b58-4ca8-a389-19ae8c8cd4ad tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:31.403752 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c4b1d82a-1b58-4ca8-a389-19ae8c8cd4ad tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:31.410688 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c4b1d82a-1b58-4ca8-a389-19ae8c8cd4ad tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:31.411343 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c4b1d82a-1b58-4ca8-a389-19ae8c8cd4ad tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:31.412112 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c4b1d82a-1b58-4ca8-a389-19ae8c8cd4ad tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:31.412540 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c4b1d82a-1b58-4ca8-a389-19ae8c8cd4ad tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:31.558225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c4b1d82a-1b58-4ca8-a389-19ae8c8cd4ad tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:31.572217 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c4b1d82a-1b58-4ca8-a389-19ae8c8cd4ad tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.173385 May 09 23:03:31.572855 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 65/129] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:31 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:32.392152 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1b8336e4-b641-440e-8c5b-c84d354204fe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:32.393525 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1b8336e4-b641-440e-8c5b-c84d354204fe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:32.401503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b8336e4-b641-440e-8c5b-c84d354204fe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:32.402309 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b8336e4-b641-440e-8c5b-c84d354204fe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:32.403484 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b8336e4-b641-440e-8c5b-c84d354204fe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:32.404215 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b8336e4-b641-440e-8c5b-c84d354204fe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:32.589039 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d45ce558-0db5-4cfd-b60f-5f5341f8e55d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:32.589652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d45ce558-0db5-4cfd-b60f-5f5341f8e55d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:32.591409 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1b8336e4-b641-440e-8c5b-c84d354204fe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:32.600629 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1b8336e4-b641-440e-8c5b-c84d354204fe tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1551 microversion: 2.1 time: 0.226624 May 09 23:03:32.601856 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 65/130] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:32 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1551 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:32.608549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d45ce558-0db5-4cfd-b60f-5f5341f8e55d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:32.608549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d45ce558-0db5-4cfd-b60f-5f5341f8e55d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:32.608549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d45ce558-0db5-4cfd-b60f-5f5341f8e55d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:32.608549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d45ce558-0db5-4cfd-b60f-5f5341f8e55d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:32.957519 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d45ce558-0db5-4cfd-b60f-5f5341f8e55d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:32.970612 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d45ce558-0db5-4cfd-b60f-5f5341f8e55d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.385264 May 09 23:03:32.971204 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 66/131] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:32 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:33.469206 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-85e4ef51-9642-4129-b7e1-0413c7f3abdd req-c6f4233e-0917-4ef8-bcdd-44136d2df793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ed65f5-3706-4a36-8ca4-5e09a2354d07", "name": "network-vif-deleted", "tag": "d0f35359-5f2a-472a-967f-5319c7350ff9"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:03:33.479515 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-85e4ef51-9642-4129-b7e1-0413c7f3abdd req-c6f4233e-0917-4ef8-bcdd-44136d2df793 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:33.480114 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-85e4ef51-9642-4129-b7e1-0413c7f3abdd req-c6f4233e-0917-4ef8-bcdd-44136d2df793 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:33.494666 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-85e4ef51-9642-4129-b7e1-0413c7f3abdd req-c6f4233e-0917-4ef8-bcdd-44136d2df793 service nova] Creating event network-vif-deleted:d0f35359-5f2a-472a-967f-5319c7350ff9 for instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 on hv-cinder-84067 May 09 23:03:33.503352 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-85e4ef51-9642-4129-b7e1-0413c7f3abdd req-c6f4233e-0917-4ef8-bcdd-44136d2df793 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131815 May 09 23:03:33.506993 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 66/132] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:03:33.618650 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d921f885-9a2c-45a3-acc5-0104a7a3649f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:33.619256 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d921f885-9a2c-45a3-acc5-0104a7a3649f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:33.626919 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d921f885-9a2c-45a3-acc5-0104a7a3649f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:33.627393 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d921f885-9a2c-45a3-acc5-0104a7a3649f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:33.628154 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d921f885-9a2c-45a3-acc5-0104a7a3649f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:33.628589 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d921f885-9a2c-45a3-acc5-0104a7a3649f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:33.703700 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d921f885-9a2c-45a3-acc5-0104a7a3649f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90018602e07f4a4ca5f46c5c85bc818e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805f702593a4c379db7cdeec818f94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:33.714211 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d921f885-9a2c-45a3-acc5-0104a7a3649f tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 200 len: 1345 microversion: 2.1 time: 0.099350 May 09 23:03:33.714885 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 67/133] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:33 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 1345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:33.989240 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ccaf2c47-d867-41fe-81a6-e9f9e1706022 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:33.989966 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ccaf2c47-d867-41fe-81a6-e9f9e1706022 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:33.995997 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ccaf2c47-d867-41fe-81a6-e9f9e1706022 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:33.996447 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ccaf2c47-d867-41fe-81a6-e9f9e1706022 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:33.997216 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ccaf2c47-d867-41fe-81a6-e9f9e1706022 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:33.997654 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ccaf2c47-d867-41fe-81a6-e9f9e1706022 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:34.168860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ccaf2c47-d867-41fe-81a6-e9f9e1706022 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:34.176357 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ccaf2c47-d867-41fe-81a6-e9f9e1706022 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.192345 May 09 23:03:34.177404 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 67/134] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:33 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:34.731123 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-036cc8ab-7a5c-4198-b1f8-1b8f408f5707 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:34.731915 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-036cc8ab-7a5c-4198-b1f8-1b8f408f5707 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:34.741055 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-036cc8ab-7a5c-4198-b1f8-1b8f408f5707 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:34.741055 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-036cc8ab-7a5c-4198-b1f8-1b8f408f5707 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:34.741055 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-036cc8ab-7a5c-4198-b1f8-1b8f408f5707 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:34.741055 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-036cc8ab-7a5c-4198-b1f8-1b8f408f5707 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:34.758152 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-036cc8ab-7a5c-4198-b1f8-1b8f408f5707 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] HTTP exception thrown: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-036cc8ab-7a5c-4198-b1f8-1b8f408f5707 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Request method failure captured: May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 HTTP/1.1 May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ1577xBEVANvGuStEUTQ4ofKmdPfVbPAAYdLxMKwTgjubhtb5Iof3DeiP64J1Wgf8zQGs-ypCxHFVkfg-GdBplONYIZai7RjPbHC-yr2m-GCEUO-2usWXTbYjftEHsbV4Rv9ZQMqvaJI00dM1Mh_Dg07db_nZElyj0E1gv7fL3dCs8 May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 0805f702593a4c379db7cdeec818f94b May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-DeleteServersTestJSON-490619851 May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:03:34.763800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:03:34.765644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0805f702593a4c379db7cdeec818f94b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0805f702593a4c379db7cdeec818f94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0805f702593a4c379db7cdeec818f94b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0805f702593a4c379db7cdeec818f94b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:03:34.765644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-DeleteServersTestJSON-490619851 May 09 23:03:34.765644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 0805f702593a4c379db7cdeec818f94b May 09 23:03:34.765644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-DeleteServersTestJSON-490619851 May 09 23:03:34.765644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-DeleteServersTestJSON-490619851-project May 09 23:03:34.765644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:03:34.765644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:03:34.765644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 90018602e07f4a4ca5f46c5c85bc818e May 09 23:03:34.765644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-DeleteServersTestJSON-490619851-project May 09 23:03:34.765644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:03:34.765644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:34.765644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': 'e3ed65f5-3706-4a36-8ca4-5e09a2354d07'} May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:03:34.766488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:34.767529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:03:34.769686 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-036cc8ab-7a5c-4198-b1f8-1b8f408f5707 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Returning 404 to user: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:03:34.769686 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-036cc8ab-7a5c-4198-b1f8-1b8f408f5707 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 404 len: 111 microversion: 2.1 time: 0.038221 May 09 23:03:34.769686 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 68/135] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:34 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:03:34.891402 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-614657db-6b86-40a7-8ef0-d693a9c98d6a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:34.892423 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-614657db-6b86-40a7-8ef0-d693a9c98d6a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:34.899875 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-614657db-6b86-40a7-8ef0-d693a9c98d6a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:34.900317 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-614657db-6b86-40a7-8ef0-d693a9c98d6a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:34.901258 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-614657db-6b86-40a7-8ef0-d693a9c98d6a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:34.901865 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-614657db-6b86-40a7-8ef0-d693a9c98d6a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:34.916200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-614657db-6b86-40a7-8ef0-d693a9c98d6a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] HTTP exception thrown: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-614657db-6b86-40a7-8ef0-d693a9c98d6a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Request method failure captured: May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07/os-volume_attachments HTTP/1.1 May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ1577xBEVANvGuStEUTQ4ofKmdPfVbPAAYdLxMKwTgjubhtb5Iof3DeiP64J1Wgf8zQGs-ypCxHFVkfg-GdBplONYIZai7RjPbHC-yr2m-GCEUO-2usWXTbYjftEHsbV4Rv9ZQMqvaJI00dM1Mh_Dg07db_nZElyj0E1gv7fL3dCs8 May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: 0805f702593a4c379db7cdeec818f94b May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-DeleteServersTestJSON-490619851 May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:03:34.921968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:03:34.923503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0805f702593a4c379db7cdeec818f94b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0805f702593a4c379db7cdeec818f94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0805f702593a4c379db7cdeec818f94b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0805f702593a4c379db7cdeec818f94b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:03:34.923503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-DeleteServersTestJSON-490619851 May 09 23:03:34.923503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: 0805f702593a4c379db7cdeec818f94b May 09 23:03:34.923503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-DeleteServersTestJSON-490619851 May 09 23:03:34.923503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-DeleteServersTestJSON-490619851-project May 09 23:03:34.923503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:03:34.923503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:03:34.923503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 90018602e07f4a4ca5f46c5c85bc818e May 09 23:03:34.923503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-DeleteServersTestJSON-490619851-project May 09 23:03:34.923503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:03:34.923503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:34.923503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'server_id': 'e3ed65f5-3706-4a36-8ca4-5e09a2354d07'} May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:03:34.924378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:34.925480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:03:34.928499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-614657db-6b86-40a7-8ef0-d693a9c98d6a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Returning 404 to user: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:03:34.928499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-614657db-6b86-40a7-8ef0-d693a9c98d6a tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038446 May 09 23:03:34.928499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 68/136] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:03:34 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:03:35.194648 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-395aabd5-9cec-4899-a350-5d207a5e4419 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:35.195257 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-395aabd5-9cec-4899-a350-5d207a5e4419 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:35.201455 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-395aabd5-9cec-4899-a350-5d207a5e4419 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:35.201902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-395aabd5-9cec-4899-a350-5d207a5e4419 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:35.202733 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-395aabd5-9cec-4899-a350-5d207a5e4419 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:35.203159 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-395aabd5-9cec-4899-a350-5d207a5e4419 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:35.531462 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-395aabd5-9cec-4899-a350-5d207a5e4419 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:35.540199 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-395aabd5-9cec-4899-a350-5d207a5e4419 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.348488 May 09 23:03:35.554450 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 69/137] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:35 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:36.151900 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9b39c58c-ff03-40e1-b2f6-6a8f1b8c9638 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:36.152466 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9b39c58c-ff03-40e1-b2f6-6a8f1b8c9638 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:36.159459 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9b39c58c-ff03-40e1-b2f6-6a8f1b8c9638 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:36.159459 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9b39c58c-ff03-40e1-b2f6-6a8f1b8c9638 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:36.160192 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9b39c58c-ff03-40e1-b2f6-6a8f1b8c9638 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:36.160629 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9b39c58c-ff03-40e1-b2f6-6a8f1b8c9638 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:36.174396 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-9b39c58c-ff03-40e1-b2f6-6a8f1b8c9638 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] HTTP exception thrown: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9b39c58c-ff03-40e1-b2f6-6a8f1b8c9638 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Request method failure captured: May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: DELETE /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 HTTP/1.1 May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ1577xBEVANvGuStEUTQ4ofKmdPfVbPAAYdLxMKwTgjubhtb5Iof3DeiP64J1Wgf8zQGs-ypCxHFVkfg-GdBplONYIZai7RjPbHC-yr2m-GCEUO-2usWXTbYjftEHsbV4Rv9ZQMqvaJI00dM1Mh_Dg07db_nZElyj0E1gv7fL3dCs8 May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: 0805f702593a4c379db7cdeec818f94b May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-DeleteServersTestJSON-490619851 May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:03:36.176930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:03:36.178205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0805f702593a4c379db7cdeec818f94b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0805f702593a4c379db7cdeec818f94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0805f702593a4c379db7cdeec818f94b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0805f702593a4c379db7cdeec818f94b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:03:36.178205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-DeleteServersTestJSON-490619851 May 09 23:03:36.178205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: 0805f702593a4c379db7cdeec818f94b May 09 23:03:36.178205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-DeleteServersTestJSON-490619851 May 09 23:03:36.178205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-DeleteServersTestJSON-490619851-project May 09 23:03:36.178205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:03:36.178205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:03:36.178205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 90018602e07f4a4ca5f46c5c85bc818e May 09 23:03:36.178205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-DeleteServersTestJSON-490619851-project May 09 23:03:36.178205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:03:36.178205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:36.178205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': 'e3ed65f5-3706-4a36-8ca4-5e09a2354d07'} May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:03:36.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:36.179992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:03:36.181144 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9b39c58c-ff03-40e1-b2f6-6a8f1b8c9638 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Returning 404 to user: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:03:36.181144 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9b39c58c-ff03-40e1-b2f6-6a8f1b8c9638 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 404 len: 111 microversion: 2.1 time: 0.030265 May 09 23:03:36.181144 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 69/138] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:03:36 2022] DELETE /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:03:36.189223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e7860670-161a-47f8-b152-815cff043e73 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:36.189756 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e7860670-161a-47f8-b152-815cff043e73 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] [instance: e3ed65f5-3706-4a36-8ca4-5e09a2354d07] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:36.197391 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e7860670-161a-47f8-b152-815cff043e73 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:36.198060 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e7860670-161a-47f8-b152-815cff043e73 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:36.199157 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e7860670-161a-47f8-b152-815cff043e73 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:36.199740 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e7860670-161a-47f8-b152-815cff043e73 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:36.222178 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-e7860670-161a-47f8-b152-815cff043e73 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] HTTP exception thrown: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e7860670-161a-47f8-b152-815cff043e73 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Request method failure captured: May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 HTTP/1.1 May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ1577xBEVANvGuStEUTQ4ofKmdPfVbPAAYdLxMKwTgjubhtb5Iof3DeiP64J1Wgf8zQGs-ypCxHFVkfg-GdBplONYIZai7RjPbHC-yr2m-GCEUO-2usWXTbYjftEHsbV4Rv9ZQMqvaJI00dM1Mh_Dg07db_nZElyj0E1gv7fL3dCs8 May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 0805f702593a4c379db7cdeec818f94b May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-DeleteServersTestJSON-490619851 May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:03:36.225463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:03:36.226920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0805f702593a4c379db7cdeec818f94b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0805f702593a4c379db7cdeec818f94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0805f702593a4c379db7cdeec818f94b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0805f702593a4c379db7cdeec818f94b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:03:36.226920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-DeleteServersTestJSON-490619851 May 09 23:03:36.226920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 0805f702593a4c379db7cdeec818f94b May 09 23:03:36.226920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-DeleteServersTestJSON-490619851 May 09 23:03:36.226920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-DeleteServersTestJSON-490619851-project May 09 23:03:36.226920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:03:36.226920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:03:36.226920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 90018602e07f4a4ca5f46c5c85bc818e May 09 23:03:36.226920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-DeleteServersTestJSON-490619851-project May 09 23:03:36.226920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:03:36.226920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:36.226920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': 'e3ed65f5-3706-4a36-8ca4-5e09a2354d07'} May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:03:36.227810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. May 09 23:03:36.229126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:03:36.231433 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e7860670-161a-47f8-b152-815cff043e73 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] Returning 404 to user: Instance e3ed65f5-3706-4a36-8ca4-5e09a2354d07 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:03:36.232570 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e7860670-161a-47f8-b152-815cff043e73 tempest-DeleteServersTestJSON-490619851 tempest-DeleteServersTestJSON-490619851-project] 10.222.0.23 "GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07" status: 404 len: 111 microversion: 2.1 time: 0.048373 May 09 23:03:36.233145 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 70/139] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:36 2022] GET /compute/v2.1/servers/e3ed65f5-3706-4a36-8ca4-5e09a2354d07 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:03:36.556477 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-28d0d59f-6d18-4722-90d8-1a8fdcb2167d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:36.557589 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-28d0d59f-6d18-4722-90d8-1a8fdcb2167d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:36.565587 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-28d0d59f-6d18-4722-90d8-1a8fdcb2167d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:36.566049 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-28d0d59f-6d18-4722-90d8-1a8fdcb2167d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:36.568982 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-28d0d59f-6d18-4722-90d8-1a8fdcb2167d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:36.570743 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-28d0d59f-6d18-4722-90d8-1a8fdcb2167d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:37.083183 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-28d0d59f-6d18-4722-90d8-1a8fdcb2167d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:37.091217 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-28d0d59f-6d18-4722-90d8-1a8fdcb2167d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.538422 May 09 23:03:37.091880 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 70/140] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:36 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:37.117161 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-548010626", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452"}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:03:38.109540 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-80eb625a-9418-4819-8237-1a16d0c77ba8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:38.110271 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-80eb625a-9418-4819-8237-1a16d0c77ba8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:38.116343 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-80eb625a-9418-4819-8237-1a16d0c77ba8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:38.116887 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-80eb625a-9418-4819-8237-1a16d0c77ba8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:38.117743 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-80eb625a-9418-4819-8237-1a16d0c77ba8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:38.118286 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-80eb625a-9418-4819-8237-1a16d0c77ba8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:38.264133 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-80eb625a-9418-4819-8237-1a16d0c77ba8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:38.271877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-80eb625a-9418-4819-8237-1a16d0c77ba8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.167063 May 09 23:03:38.272578 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 71/141] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:38 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:39.288932 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-226c6543-9b89-4f28-9741-2d0cec0939f4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:39.290377 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-226c6543-9b89-4f28-9741-2d0cec0939f4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:39.297000 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-226c6543-9b89-4f28-9741-2d0cec0939f4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:39.297889 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-226c6543-9b89-4f28-9741-2d0cec0939f4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:39.298821 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-226c6543-9b89-4f28-9741-2d0cec0939f4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:39.299487 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-226c6543-9b89-4f28-9741-2d0cec0939f4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:39.454284 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-226c6543-9b89-4f28-9741-2d0cec0939f4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:39.464535 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-226c6543-9b89-4f28-9741-2d0cec0939f4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.179461 May 09 23:03:39.466875 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 72/142] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:39 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:40.483013 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-37df85b1-fe1d-4f54-a1fe-fe4aa32d1a0f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:40.483703 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-37df85b1-fe1d-4f54-a1fe-fe4aa32d1a0f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:40.489674 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-37df85b1-fe1d-4f54-a1fe-fe4aa32d1a0f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:40.490357 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-37df85b1-fe1d-4f54-a1fe-fe4aa32d1a0f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:40.491324 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-37df85b1-fe1d-4f54-a1fe-fe4aa32d1a0f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:40.491763 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-37df85b1-fe1d-4f54-a1fe-fe4aa32d1a0f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:40.636962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-37df85b1-fe1d-4f54-a1fe-fe4aa32d1a0f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:40.645582 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-37df85b1-fe1d-4f54-a1fe-fe4aa32d1a0f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.166538 May 09 23:03:40.646380 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 73/143] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:40 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:41.204907 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.network.neutron [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] validate_networks() for None {{(pid=117143) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:03:41.663002 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-6dd8315b-7db0-43c4-97ff-2c4b4556fd07 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:41.663622 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-6dd8315b-7db0-43c4-97ff-2c4b4556fd07 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:41.682311 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6dd8315b-7db0-43c4-97ff-2c4b4556fd07 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:41.682937 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6dd8315b-7db0-43c4-97ff-2c4b4556fd07 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:41.684032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6dd8315b-7db0-43c4-97ff-2c4b4556fd07 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:41.685128 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6dd8315b-7db0-43c4-97ff-2c4b4556fd07 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:41.708712 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Flavor limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:03:41.709322 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Image limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:03:41.709953 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Flavor pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:03:41.710459 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Image pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:03:41.710873 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:03:41.723039 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:41.723490 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:41.724308 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:41.727177 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:41.750898 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Getting quotas for project fcbf3360a1654ddbbc5812f5ea706eb6. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:03:41.755432 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Getting quotas for user 0f9a151d58eb4c8a8e99c1e35e6723f6 and project fcbf3360a1654ddbbc5812f5ea706eb6. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:03:41.782023 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Going to run 1 instances... {{(pid=117143) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:03:41.785621 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:03:41.893560 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7e8a70b1-3769-4028-ac71-b4da47720c96 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.775592 May 09 23:03:41.897344 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-6dd8315b-7db0-43c4-97ff-2c4b4556fd07 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:41.899511 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 71/144] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:03:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 4787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:03:41.906050 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2406f494-3b76-4b84-8e22-b814cf928218 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:41.906864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2406f494-3b76-4b84-8e22-b814cf928218 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:41.909209 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-6dd8315b-7db0-43c4-97ff-2c4b4556fd07 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.250141 May 09 23:03:41.910396 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 74/145] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:41 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:42.036743 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2406f494-3b76-4b84-8e22-b814cf928218 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:42.045746 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2406f494-3b76-4b84-8e22-b814cf928218 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1214 microversion: 2.1 time: 0.144047 May 09 23:03:42.048319 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 72/146] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:41 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:42.940970 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f258be75-9ca2-4f0b-8bae-06cf9232a84c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:42.944552 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f258be75-9ca2-4f0b-8bae-06cf9232a84c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:42.963028 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f258be75-9ca2-4f0b-8bae-06cf9232a84c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:42.963720 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f258be75-9ca2-4f0b-8bae-06cf9232a84c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:42.964699 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f258be75-9ca2-4f0b-8bae-06cf9232a84c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:42.971216 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f258be75-9ca2-4f0b-8bae-06cf9232a84c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:43.067123 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1c3e1ec0-469f-4b44-91fa-18bd22221127 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:43.068456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1c3e1ec0-469f-4b44-91fa-18bd22221127 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:43.076473 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1c3e1ec0-469f-4b44-91fa-18bd22221127 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:43.077201 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1c3e1ec0-469f-4b44-91fa-18bd22221127 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:43.078217 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1c3e1ec0-469f-4b44-91fa-18bd22221127 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:43.078840 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1c3e1ec0-469f-4b44-91fa-18bd22221127 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:43.129776 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f258be75-9ca2-4f0b-8bae-06cf9232a84c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:43.138868 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f258be75-9ca2-4f0b-8bae-06cf9232a84c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.211703 May 09 23:03:43.139547 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 75/147] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:42 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:43.189894 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1c3e1ec0-469f-4b44-91fa-18bd22221127 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:43.201853 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1c3e1ec0-469f-4b44-91fa-18bd22221127 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1266 microversion: 2.1 time: 0.140830 May 09 23:03:43.213902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 73/148] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:43 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:44.160894 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-4c6a10e7-3dc6-4e0d-9106-49fca5d4aa1d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:44.162493 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-4c6a10e7-3dc6-4e0d-9106-49fca5d4aa1d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:44.177606 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4c6a10e7-3dc6-4e0d-9106-49fca5d4aa1d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:44.178403 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4c6a10e7-3dc6-4e0d-9106-49fca5d4aa1d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:44.179854 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4c6a10e7-3dc6-4e0d-9106-49fca5d4aa1d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:44.180732 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4c6a10e7-3dc6-4e0d-9106-49fca5d4aa1d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:44.252099 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-7e010401-b81f-4fe1-9c7b-5437e345f2a4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Action: 'create', calling method: .version_select at 0x7fc28bddf5e0>, body: {"keypair": {"name": "tempest-keypair-545634904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSU1juKbIpG7o54GZzho7zjZ0uh+rXIeKIH+n8DyPN++QiQwO9SaCkIuMc1UtnOO/8XkTUmODlWjKufgU6TCcYv/mlO5WidWtCOytRoHiuC+c02biKWgFvtwndgR/Tenw=="}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:03:44.267666 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-7e010401-b81f-4fe1-9c7b-5437e345f2a4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Getting quotas for project 0f38af4b388e49958aa17250c181b203. Resources: {'key_pairs'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:03:44.271799 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-7e010401-b81f-4fe1-9c7b-5437e345f2a4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Getting quotas for user c950754974d748519118d974492f15ce and project 0f38af4b388e49958aa17250c181b203. Resources: {'key_pairs'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:03:44.299765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-7e010401-b81f-4fe1-9c7b-5437e345f2a4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.181728 May 09 23:03:44.301783 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 76/149] 10.222.0.23 () {62 vars in 1199 bytes} [Mon May 9 23:03:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 09 23:03:44.318766 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fd47812f-d840-46d4-bf20-de4c974ba28c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:44.319966 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-fd47812f-d840-46d4-bf20-de4c974ba28c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:44.329832 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fd47812f-d840-46d4-bf20-de4c974ba28c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:44.330431 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fd47812f-d840-46d4-bf20-de4c974ba28c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:44.331467 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fd47812f-d840-46d4-bf20-de4c974ba28c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:44.331970 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fd47812f-d840-46d4-bf20-de4c974ba28c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:44.420321 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-fd47812f-d840-46d4-bf20-de4c974ba28c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:44.428726 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-fd47812f-d840-46d4-bf20-de4c974ba28c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1272 microversion: 2.1 time: 0.125644 May 09 23:03:44.429963 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 77/150] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:44 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:44.542087 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4c6a10e7-3dc6-4e0d-9106-49fca5d4aa1d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:44.549750 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-4c6a10e7-3dc6-4e0d-9106-49fca5d4aa1d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.397097 May 09 23:03:44.550797 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 74/151] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:44 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:45.458682 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1155464e-df94-4a91-94ab-185fbd0d7c5c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:45.459954 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1155464e-df94-4a91-94ab-185fbd0d7c5c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:45.468614 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1155464e-df94-4a91-94ab-185fbd0d7c5c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:45.469347 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1155464e-df94-4a91-94ab-185fbd0d7c5c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:45.470166 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1155464e-df94-4a91-94ab-185fbd0d7c5c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:45.470916 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1155464e-df94-4a91-94ab-185fbd0d7c5c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:45.570262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-4b39d039-822c-4e3d-9554-ba9f9f727a28 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:45.572962 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-4b39d039-822c-4e3d-9554-ba9f9f727a28 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:45.585290 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4b39d039-822c-4e3d-9554-ba9f9f727a28 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:45.586492 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4b39d039-822c-4e3d-9554-ba9f9f727a28 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:45.587717 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4b39d039-822c-4e3d-9554-ba9f9f727a28 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:45.588403 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4b39d039-822c-4e3d-9554-ba9f9f727a28 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:45.748152 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1155464e-df94-4a91-94ab-185fbd0d7c5c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:45.759081 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1155464e-df94-4a91-94ab-185fbd0d7c5c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1314 microversion: 2.1 time: 0.307505 May 09 23:03:45.770311 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 78/152] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:45 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:45.982914 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4b39d039-822c-4e3d-9554-ba9f9f727a28 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:45.997915 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-4b39d039-822c-4e3d-9554-ba9f9f727a28 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.432680 May 09 23:03:45.999874 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 75/153] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:45 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:46.344702 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-125614496", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "741b3e88-dd66-49da-aaee-2d7e838ad44c"}], "security_groups": [{"name": "tempest-securitygroup--1222885007"}], "key_name": "tempest-keypair-545634904", "user_data": "}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:03:46.506258 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.network.neutron [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] validate_networks() for [('741b3e88-dd66-49da-aaee-2d7e838ad44c', None, None, None, None, None)] {{(pid=117142) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:03:46.551094 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-dc4b734c-568c-4b60-9f6c-c9c141311180 req-31217061-f559-45a1-a576-47b63300c887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77bb953a-1e2c-4c3b-a4cb-f21a9b87c493", "tag": "1cbdddf0-c2b1-47df-b760-5d077761c252"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:03:46.588234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-dc4b734c-568c-4b60-9f6c-c9c141311180 req-31217061-f559-45a1-a576-47b63300c887 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:46.590228 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-dc4b734c-568c-4b60-9f6c-c9c141311180 req-31217061-f559-45a1-a576-47b63300c887 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:46.608953 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-dc4b734c-568c-4b60-9f6c-c9c141311180 req-31217061-f559-45a1-a576-47b63300c887 service nova] Creating event network-changed:1cbdddf0-c2b1-47df-b760-5d077761c252 for instance 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 on hv-cinder-84067 May 09 23:03:46.616600 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-dc4b734c-568c-4b60-9f6c-c9c141311180 req-31217061-f559-45a1-a576-47b63300c887 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068558 May 09 23:03:46.617550 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 76/154] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:03:46.778155 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-519dfcec-2d2e-42e0-bb79-e1459fc6b97e tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:46.778891 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-519dfcec-2d2e-42e0-bb79-e1459fc6b97e tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:46.793694 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-519dfcec-2d2e-42e0-bb79-e1459fc6b97e tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:46.794300 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-519dfcec-2d2e-42e0-bb79-e1459fc6b97e tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:46.795164 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-519dfcec-2d2e-42e0-bb79-e1459fc6b97e tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:46.797951 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-519dfcec-2d2e-42e0-bb79-e1459fc6b97e tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:47.091445 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-519dfcec-2d2e-42e0-bb79-e1459fc6b97e tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:47.100510 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-519dfcec-2d2e-42e0-bb79-e1459fc6b97e tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1314 microversion: 2.1 time: 0.327426 May 09 23:03:47.111189 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 77/155] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:46 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:47.116563 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c54b21d5-cee7-467f-b3ca-d36c8e70cc75 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:47.117355 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c54b21d5-cee7-467f-b3ca-d36c8e70cc75 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:47.125152 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c54b21d5-cee7-467f-b3ca-d36c8e70cc75 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:47.125858 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c54b21d5-cee7-467f-b3ca-d36c8e70cc75 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:47.127087 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c54b21d5-cee7-467f-b3ca-d36c8e70cc75 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:47.127938 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c54b21d5-cee7-467f-b3ca-d36c8e70cc75 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:47.243200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Flavor limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:03:47.243883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Image limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:03:47.244559 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Flavor pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:03:47.245638 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Image pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:03:47.246274 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:03:47.263555 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:47.264106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:47.265046 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:47.266793 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:47.301462 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Getting quotas for project 0f38af4b388e49958aa17250c181b203. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:03:47.306211 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Getting quotas for user c950754974d748519118d974492f15ce and project 0f38af4b388e49958aa17250c181b203. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:03:47.323632 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Going to run 1 instances... {{(pid=117142) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:03:47.326645 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:03:47.420059 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c54b21d5-cee7-467f-b3ca-d36c8e70cc75 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:47.435486 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c54b21d5-cee7-467f-b3ca-d36c8e70cc75 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.322819 May 09 23:03:47.445678 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 78/156] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:47 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:47.486569 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-71eb818a-5bbd-4735-90f4-0dc57fe03e64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.146497 May 09 23:03:47.490283 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 79/157] 10.222.0.23 () {62 vars in 1187 bytes} [Mon May 9 23:03:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 09 23:03:47.499117 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d4140867-36a0-4e52-b6d7-42b846904af4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:47.499992 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d4140867-36a0-4e52-b6d7-42b846904af4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:47.629358 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d4140867-36a0-4e52-b6d7-42b846904af4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:47.658080 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d4140867-36a0-4e52-b6d7-42b846904af4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:47.670565 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d4140867-36a0-4e52-b6d7-42b846904af4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:47.674178 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d4140867-36a0-4e52-b6d7-42b846904af4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1280 microversion: 2.20 time: 0.180367 May 09 23:03:47.676223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 79/158] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:03:47 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1280 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:03:48.118832 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-57c5fa32-21f2-433d-b569-de715db9a50a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:48.120108 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-57c5fa32-21f2-433d-b569-de715db9a50a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:48.127124 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-57c5fa32-21f2-433d-b569-de715db9a50a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:48.130872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-57c5fa32-21f2-433d-b569-de715db9a50a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:48.130872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-57c5fa32-21f2-433d-b569-de715db9a50a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:48.130872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-57c5fa32-21f2-433d-b569-de715db9a50a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:48.312400 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-57c5fa32-21f2-433d-b569-de715db9a50a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:48.322939 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-57c5fa32-21f2-433d-b569-de715db9a50a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1314 microversion: 2.1 time: 0.208251 May 09 23:03:48.326107 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 80/159] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:48 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:48.460995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ec3b196f-d45a-40de-af54-440223989cd7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:48.461767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ec3b196f-d45a-40de-af54-440223989cd7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:48.472157 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ec3b196f-d45a-40de-af54-440223989cd7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:48.476103 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ec3b196f-d45a-40de-af54-440223989cd7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:48.477060 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ec3b196f-d45a-40de-af54-440223989cd7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:48.477599 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ec3b196f-d45a-40de-af54-440223989cd7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:48.679628 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ec3b196f-d45a-40de-af54-440223989cd7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:48.691653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ec3b196f-d45a-40de-af54-440223989cd7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.235726 May 09 23:03:48.692237 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 80/160] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:48 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:48.695633 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-6cd8bcf6-d481-49d8-9373-7c52d969dc89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:48.697398 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-6cd8bcf6-d481-49d8-9373-7c52d969dc89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:48.712169 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6cd8bcf6-d481-49d8-9373-7c52d969dc89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:48.712827 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6cd8bcf6-d481-49d8-9373-7c52d969dc89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:48.713761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6cd8bcf6-d481-49d8-9373-7c52d969dc89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:48.714382 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6cd8bcf6-d481-49d8-9373-7c52d969dc89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:48.782811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-6cd8bcf6-d481-49d8-9373-7c52d969dc89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:48.790978 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-6cd8bcf6-d481-49d8-9373-7c52d969dc89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:48.792494 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-6cd8bcf6-d481-49d8-9373-7c52d969dc89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:48.793591 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-6cd8bcf6-d481-49d8-9373-7c52d969dc89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1332 microversion: 2.20 time: 0.103877 May 09 23:03:48.794174 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 81/161] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:03:48 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:03:49.343674 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-cd0dc873-c1c0-4491-8301-7ac47064d3a0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:49.344586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-cd0dc873-c1c0-4491-8301-7ac47064d3a0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:49.350593 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cd0dc873-c1c0-4491-8301-7ac47064d3a0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:49.351043 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cd0dc873-c1c0-4491-8301-7ac47064d3a0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:49.351818 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cd0dc873-c1c0-4491-8301-7ac47064d3a0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:49.352252 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cd0dc873-c1c0-4491-8301-7ac47064d3a0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:49.523615 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-cd0dc873-c1c0-4491-8301-7ac47064d3a0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:49.531410 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-cd0dc873-c1c0-4491-8301-7ac47064d3a0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1314 microversion: 2.1 time: 0.192127 May 09 23:03:49.531990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 81/162] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:49 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:49.708969 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-622d454c-87ba-4bb1-8030-4264dd01829d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:49.710223 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-622d454c-87ba-4bb1-8030-4264dd01829d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:49.715976 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-622d454c-87ba-4bb1-8030-4264dd01829d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:49.716431 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-622d454c-87ba-4bb1-8030-4264dd01829d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:49.717211 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-622d454c-87ba-4bb1-8030-4264dd01829d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:49.718197 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-622d454c-87ba-4bb1-8030-4264dd01829d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:49.816918 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-dac06a05-808d-4644-aa3a-a13ba58fcb32 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:49.817510 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-dac06a05-808d-4644-aa3a-a13ba58fcb32 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:49.824966 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dac06a05-808d-4644-aa3a-a13ba58fcb32 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:49.825651 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dac06a05-808d-4644-aa3a-a13ba58fcb32 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:49.826686 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dac06a05-808d-4644-aa3a-a13ba58fcb32 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:49.827453 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dac06a05-808d-4644-aa3a-a13ba58fcb32 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:49.879828 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-622d454c-87ba-4bb1-8030-4264dd01829d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:49.888068 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-622d454c-87ba-4bb1-8030-4264dd01829d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.182835 May 09 23:03:49.888757 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 82/163] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:49 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:49.902653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-dac06a05-808d-4644-aa3a-a13ba58fcb32 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:49.911898 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-dac06a05-808d-4644-aa3a-a13ba58fcb32 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:49.913395 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-dac06a05-808d-4644-aa3a-a13ba58fcb32 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:49.914521 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-dac06a05-808d-4644-aa3a-a13ba58fcb32 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1332 microversion: 2.20 time: 0.102357 May 09 23:03:49.915083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 82/164] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:03:49 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:03:50.548950 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-12660533-4a69-4f45-8823-8f4083ef6460 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:50.549673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-12660533-4a69-4f45-8823-8f4083ef6460 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:50.555553 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-12660533-4a69-4f45-8823-8f4083ef6460 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:50.556009 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-12660533-4a69-4f45-8823-8f4083ef6460 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:50.556782 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-12660533-4a69-4f45-8823-8f4083ef6460 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:50.557223 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-12660533-4a69-4f45-8823-8f4083ef6460 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:50.691685 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-12660533-4a69-4f45-8823-8f4083ef6460 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:50.698973 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-12660533-4a69-4f45-8823-8f4083ef6460 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1314 microversion: 2.1 time: 0.154800 May 09 23:03:50.699540 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 83/165] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:50 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:50.904722 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-91aa5ad3-2411-433d-b46f-57f7086c471d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:50.905950 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-91aa5ad3-2411-433d-b46f-57f7086c471d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:50.912141 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-91aa5ad3-2411-433d-b46f-57f7086c471d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:50.912594 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-91aa5ad3-2411-433d-b46f-57f7086c471d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:50.913368 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-91aa5ad3-2411-433d-b46f-57f7086c471d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:50.913805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-91aa5ad3-2411-433d-b46f-57f7086c471d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:50.935307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-3fbe8b24-8de7-400e-9a90-e48eefb42b4b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:50.935862 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-3fbe8b24-8de7-400e-9a90-e48eefb42b4b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:50.942748 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3fbe8b24-8de7-400e-9a90-e48eefb42b4b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:50.943205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3fbe8b24-8de7-400e-9a90-e48eefb42b4b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:50.944005 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3fbe8b24-8de7-400e-9a90-e48eefb42b4b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:50.944620 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3fbe8b24-8de7-400e-9a90-e48eefb42b4b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:51.018963 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-3fbe8b24-8de7-400e-9a90-e48eefb42b4b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:51.030937 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-3fbe8b24-8de7-400e-9a90-e48eefb42b4b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:51.033001 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-3fbe8b24-8de7-400e-9a90-e48eefb42b4b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:51.034656 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-3fbe8b24-8de7-400e-9a90-e48eefb42b4b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1332 microversion: 2.20 time: 0.103873 May 09 23:03:51.043669 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 84/166] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:03:50 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:03:51.066653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-91aa5ad3-2411-433d-b46f-57f7086c471d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:51.073930 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-91aa5ad3-2411-433d-b46f-57f7086c471d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.172946 May 09 23:03:51.074534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 83/167] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:50 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:51.716644 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f2849abd-52c3-45ee-9e56-08dd8ca68c29 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:51.718499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f2849abd-52c3-45ee-9e56-08dd8ca68c29 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:51.727564 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f2849abd-52c3-45ee-9e56-08dd8ca68c29 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:51.728023 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f2849abd-52c3-45ee-9e56-08dd8ca68c29 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:51.728815 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f2849abd-52c3-45ee-9e56-08dd8ca68c29 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:51.729249 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f2849abd-52c3-45ee-9e56-08dd8ca68c29 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:51.960904 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f2849abd-52c3-45ee-9e56-08dd8ca68c29 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:51.969242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f2849abd-52c3-45ee-9e56-08dd8ca68c29 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1314 microversion: 2.1 time: 0.257530 May 09 23:03:51.969821 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 85/168] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:51 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:52.053137 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-993c6751-09ec-4607-bcd9-ae30c621d50a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:52.054363 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-993c6751-09ec-4607-bcd9-ae30c621d50a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:52.065490 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-993c6751-09ec-4607-bcd9-ae30c621d50a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:52.065829 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-993c6751-09ec-4607-bcd9-ae30c621d50a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:52.066878 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-993c6751-09ec-4607-bcd9-ae30c621d50a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:52.067841 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-993c6751-09ec-4607-bcd9-ae30c621d50a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:52.090912 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-28d4f77f-081c-412e-ae66-96dd538dba0c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:52.091999 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-28d4f77f-081c-412e-ae66-96dd538dba0c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:52.101074 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-28d4f77f-081c-412e-ae66-96dd538dba0c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:52.101670 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-28d4f77f-081c-412e-ae66-96dd538dba0c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:52.102474 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-28d4f77f-081c-412e-ae66-96dd538dba0c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:52.103198 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-28d4f77f-081c-412e-ae66-96dd538dba0c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:52.161983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-993c6751-09ec-4607-bcd9-ae30c621d50a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:52.169992 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-993c6751-09ec-4607-bcd9-ae30c621d50a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:52.171633 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-993c6751-09ec-4607-bcd9-ae30c621d50a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:52.172965 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-993c6751-09ec-4607-bcd9-ae30c621d50a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1338 microversion: 2.20 time: 0.123848 May 09 23:03:52.173888 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 84/169] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:03:52 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1338 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:03:52.335146 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-28d4f77f-081c-412e-ae66-96dd538dba0c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:52.343038 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-28d4f77f-081c-412e-ae66-96dd538dba0c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.256145 May 09 23:03:52.343612 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 86/170] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:52 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:52.986712 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1393bf5a-da94-4f40-9667-5c8076339710 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:52.987560 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1393bf5a-da94-4f40-9667-5c8076339710 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:52.994251 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1393bf5a-da94-4f40-9667-5c8076339710 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:52.995017 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1393bf5a-da94-4f40-9667-5c8076339710 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:52.995875 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1393bf5a-da94-4f40-9667-5c8076339710 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:52.996380 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1393bf5a-da94-4f40-9667-5c8076339710 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:53.162900 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1393bf5a-da94-4f40-9667-5c8076339710 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:53.172761 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1393bf5a-da94-4f40-9667-5c8076339710 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1314 microversion: 2.1 time: 0.190633 May 09 23:03:53.173346 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 85/171] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:52 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:53.192238 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-507a2c03-4aab-493f-b4d8-cdb895f51049 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:53.193762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-507a2c03-4aab-493f-b4d8-cdb895f51049 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:53.207115 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-507a2c03-4aab-493f-b4d8-cdb895f51049 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:53.207644 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-507a2c03-4aab-493f-b4d8-cdb895f51049 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:53.208389 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-507a2c03-4aab-493f-b4d8-cdb895f51049 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:53.208828 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-507a2c03-4aab-493f-b4d8-cdb895f51049 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:53.360664 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-440155b8-a143-4322-96ec-d7edb0e99b39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:53.362005 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-440155b8-a143-4322-96ec-d7edb0e99b39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:53.368092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-440155b8-a143-4322-96ec-d7edb0e99b39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:53.368472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-440155b8-a143-4322-96ec-d7edb0e99b39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:53.369431 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-440155b8-a143-4322-96ec-d7edb0e99b39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:53.370065 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-440155b8-a143-4322-96ec-d7edb0e99b39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:53.517232 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-507a2c03-4aab-493f-b4d8-cdb895f51049 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:53.531036 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-507a2c03-4aab-493f-b4d8-cdb895f51049 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:53.533298 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-507a2c03-4aab-493f-b4d8-cdb895f51049 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:53.534395 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-507a2c03-4aab-493f-b4d8-cdb895f51049 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1406 microversion: 2.20 time: 0.347414 May 09 23:03:53.542877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 87/172] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:03:53 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1406 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:03:53.551635 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-9198cb7d-28a3-45c3-a3a9-57a84c68441c req-fc7fa0cc-59d8-45dd-9a21-14013bfe2b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5734d5-da65-4ee8-8684-e236f56da50a", "tag": "9b2aff87-eeca-44a4-b616-becbcd5f1d58"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:03:53.552253 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-440155b8-a143-4322-96ec-d7edb0e99b39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:53.560021 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-440155b8-a143-4322-96ec-d7edb0e99b39 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.203856 May 09 23:03:53.563425 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 86/173] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:53 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:53.572038 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-9198cb7d-28a3-45c3-a3a9-57a84c68441c req-fc7fa0cc-59d8-45dd-9a21-14013bfe2b88 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:53.572494 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-9198cb7d-28a3-45c3-a3a9-57a84c68441c req-fc7fa0cc-59d8-45dd-9a21-14013bfe2b88 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:53.585504 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-9198cb7d-28a3-45c3-a3a9-57a84c68441c req-fc7fa0cc-59d8-45dd-9a21-14013bfe2b88 service nova] Creating event network-changed:9b2aff87-eeca-44a4-b616-becbcd5f1d58 for instance 2e5734d5-da65-4ee8-8684-e236f56da50a on hv-cinder-84067 May 09 23:03:53.591452 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-9198cb7d-28a3-45c3-a3a9-57a84c68441c req-fc7fa0cc-59d8-45dd-9a21-14013bfe2b88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046806 May 09 23:03:53.592947 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 88/174] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:03:53.932158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-a4cd6fd7-91f5-427f-ac70-ee5c2ab999e8 req-73754f7b-5e71-44cb-85c2-db15319700f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77bb953a-1e2c-4c3b-a4cb-f21a9b87c493", "name": "network-vif-plugged", "status": "completed", "tag": "1cbdddf0-c2b1-47df-b760-5d077761c252"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:03:53.940894 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-a4cd6fd7-91f5-427f-ac70-ee5c2ab999e8 req-73754f7b-5e71-44cb-85c2-db15319700f7 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:53.941341 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-a4cd6fd7-91f5-427f-ac70-ee5c2ab999e8 req-73754f7b-5e71-44cb-85c2-db15319700f7 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:53.953857 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-a4cd6fd7-91f5-427f-ac70-ee5c2ab999e8 req-73754f7b-5e71-44cb-85c2-db15319700f7 service nova] Creating event network-vif-plugged:1cbdddf0-c2b1-47df-b760-5d077761c252 for instance 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 on hv-cinder-84067 May 09 23:03:53.958911 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-a4cd6fd7-91f5-427f-ac70-ee5c2ab999e8 req-73754f7b-5e71-44cb-85c2-db15319700f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030445 May 09 23:03:53.959991 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 87/175] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:03:54.189837 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ac24adb7-ba02-4e06-82e3-b7f7d48c4efd tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:54.190645 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ac24adb7-ba02-4e06-82e3-b7f7d48c4efd tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:54.196861 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ac24adb7-ba02-4e06-82e3-b7f7d48c4efd tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:54.197435 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ac24adb7-ba02-4e06-82e3-b7f7d48c4efd tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:54.198091 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ac24adb7-ba02-4e06-82e3-b7f7d48c4efd tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:54.198553 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ac24adb7-ba02-4e06-82e3-b7f7d48c4efd tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:54.328559 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ac24adb7-ba02-4e06-82e3-b7f7d48c4efd tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:54.335831 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ac24adb7-ba02-4e06-82e3-b7f7d48c4efd tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1314 microversion: 2.1 time: 0.150781 May 09 23:03:54.336401 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 89/176] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:54 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:54.553793 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ab945173-c4c5-40f0-979a-c7bca5a98f2d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:54.554550 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ab945173-c4c5-40f0-979a-c7bca5a98f2d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:54.560632 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ab945173-c4c5-40f0-979a-c7bca5a98f2d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:54.561083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ab945173-c4c5-40f0-979a-c7bca5a98f2d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:54.561850 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ab945173-c4c5-40f0-979a-c7bca5a98f2d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:54.562326 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ab945173-c4c5-40f0-979a-c7bca5a98f2d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:54.579014 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f80eac43-40b2-481d-8779-3afde7101ac5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:54.579628 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f80eac43-40b2-481d-8779-3afde7101ac5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:54.585371 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f80eac43-40b2-481d-8779-3afde7101ac5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:54.585827 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f80eac43-40b2-481d-8779-3afde7101ac5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:54.586640 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f80eac43-40b2-481d-8779-3afde7101ac5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:54.587093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f80eac43-40b2-481d-8779-3afde7101ac5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:54.696563 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ab945173-c4c5-40f0-979a-c7bca5a98f2d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:54.704729 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ab945173-c4c5-40f0-979a-c7bca5a98f2d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:54.706310 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ab945173-c4c5-40f0-979a-c7bca5a98f2d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:54.707425 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ab945173-c4c5-40f0-979a-c7bca5a98f2d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1406 microversion: 2.20 time: 0.158355 May 09 23:03:54.708115 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 88/177] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:03:54 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:03:54.723376 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f80eac43-40b2-481d-8779-3afde7101ac5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:54.730701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f80eac43-40b2-481d-8779-3afde7101ac5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.155522 May 09 23:03:54.731263 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 90/178] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:54 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:55.352962 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-00809c9d-b888-4d9f-beb7-ec2aebd569d3 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:55.353800 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-00809c9d-b888-4d9f-beb7-ec2aebd569d3 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:55.360676 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-00809c9d-b888-4d9f-beb7-ec2aebd569d3 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:55.361332 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-00809c9d-b888-4d9f-beb7-ec2aebd569d3 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:55.362191 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-00809c9d-b888-4d9f-beb7-ec2aebd569d3 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:55.362733 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-00809c9d-b888-4d9f-beb7-ec2aebd569d3 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:55.496538 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-00809c9d-b888-4d9f-beb7-ec2aebd569d3 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:55.504808 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-00809c9d-b888-4d9f-beb7-ec2aebd569d3 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1314 microversion: 2.1 time: 0.155633 May 09 23:03:55.505556 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 89/179] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:55 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:55.724847 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-510bc4da-051f-483d-a298-0e82abc0f1ca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:55.725457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-510bc4da-051f-483d-a298-0e82abc0f1ca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:55.731133 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-510bc4da-051f-483d-a298-0e82abc0f1ca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:55.731583 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-510bc4da-051f-483d-a298-0e82abc0f1ca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:55.732613 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-510bc4da-051f-483d-a298-0e82abc0f1ca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:55.733041 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-510bc4da-051f-483d-a298-0e82abc0f1ca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:55.748380 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ac683825-9619-42a2-8e12-3914039519b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:55.749634 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ac683825-9619-42a2-8e12-3914039519b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:55.757045 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ac683825-9619-42a2-8e12-3914039519b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:55.757502 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ac683825-9619-42a2-8e12-3914039519b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:55.758441 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ac683825-9619-42a2-8e12-3914039519b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:55.758886 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ac683825-9619-42a2-8e12-3914039519b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:55.864042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-510bc4da-051f-483d-a298-0e82abc0f1ca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:55.872035 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-510bc4da-051f-483d-a298-0e82abc0f1ca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:55.873605 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-510bc4da-051f-483d-a298-0e82abc0f1ca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:55.874801 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-510bc4da-051f-483d-a298-0e82abc0f1ca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1406 microversion: 2.20 time: 0.153832 May 09 23:03:55.875391 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 91/180] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:03:55 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:03:55.893633 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ac683825-9619-42a2-8e12-3914039519b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:55.903048 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ac683825-9619-42a2-8e12-3914039519b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.158477 May 09 23:03:55.904043 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 90/181] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:55 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:56.522868 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-b0a71138-50f0-4117-a800-e889d5844633 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:56.523480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-b0a71138-50f0-4117-a800-e889d5844633 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:56.530488 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b0a71138-50f0-4117-a800-e889d5844633 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:56.531156 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b0a71138-50f0-4117-a800-e889d5844633 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:56.531891 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b0a71138-50f0-4117-a800-e889d5844633 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:56.532295 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b0a71138-50f0-4117-a800-e889d5844633 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:56.887306 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-b0a71138-50f0-4117-a800-e889d5844633 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:56.893892 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e4665ba6-d22a-4038-90cf-e833c9bb0d64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:56.894538 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e4665ba6-d22a-4038-90cf-e833c9bb0d64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:56.895619 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-b0a71138-50f0-4117-a800-e889d5844633 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1314 microversion: 2.1 time: 0.376641 May 09 23:03:56.896696 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 92/182] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:56 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:56.902842 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e4665ba6-d22a-4038-90cf-e833c9bb0d64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:56.903406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e4665ba6-d22a-4038-90cf-e833c9bb0d64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:56.904343 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e4665ba6-d22a-4038-90cf-e833c9bb0d64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:56.904837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e4665ba6-d22a-4038-90cf-e833c9bb0d64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:56.924567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-17bbf52d-bc7b-4ab5-8c3e-97b75e2c1ad0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:56.925006 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-17bbf52d-bc7b-4ab5-8c3e-97b75e2c1ad0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:56.931218 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-17bbf52d-bc7b-4ab5-8c3e-97b75e2c1ad0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:56.931670 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-17bbf52d-bc7b-4ab5-8c3e-97b75e2c1ad0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:56.932452 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-17bbf52d-bc7b-4ab5-8c3e-97b75e2c1ad0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:56.932885 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-17bbf52d-bc7b-4ab5-8c3e-97b75e2c1ad0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:57.105422 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e4665ba6-d22a-4038-90cf-e833c9bb0d64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:57.111502 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-17bbf52d-bc7b-4ab5-8c3e-97b75e2c1ad0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:57.118103 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e4665ba6-d22a-4038-90cf-e833c9bb0d64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:57.119311 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-17bbf52d-bc7b-4ab5-8c3e-97b75e2c1ad0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.198778 May 09 23:03:57.119986 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 93/183] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:56 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:03:57.120207 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e4665ba6-d22a-4038-90cf-e833c9bb0d64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:57.121596 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e4665ba6-d22a-4038-90cf-e833c9bb0d64 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1406 microversion: 2.20 time: 0.232215 May 09 23:03:57.122607 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 91/184] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:03:56 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:03:57.912412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9371fb63-7616-4342-ae91-c54d909e9c4f tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:57.913125 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9371fb63-7616-4342-ae91-c54d909e9c4f tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:57.918977 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9371fb63-7616-4342-ae91-c54d909e9c4f tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:57.919501 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9371fb63-7616-4342-ae91-c54d909e9c4f tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:57.920376 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9371fb63-7616-4342-ae91-c54d909e9c4f tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:57.920914 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9371fb63-7616-4342-ae91-c54d909e9c4f tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:58.049779 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-9371fb63-7616-4342-ae91-c54d909e9c4f tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:58.057062 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9371fb63-7616-4342-ae91-c54d909e9c4f tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1314 microversion: 2.1 time: 0.148455 May 09 23:03:58.057714 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 94/185] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:57 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:58.137050 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-9680f927-960a-4299-88bd-8021a8c83168 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:58.137743 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-9680f927-960a-4299-88bd-8021a8c83168 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:58.140556 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a6ea45db-31a1-4266-9456-4d1554b349be tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:58.141318 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a6ea45db-31a1-4266-9456-4d1554b349be tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:58.145491 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9680f927-960a-4299-88bd-8021a8c83168 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:58.145633 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9680f927-960a-4299-88bd-8021a8c83168 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:58.146649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9680f927-960a-4299-88bd-8021a8c83168 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:58.147150 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9680f927-960a-4299-88bd-8021a8c83168 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:58.147521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a6ea45db-31a1-4266-9456-4d1554b349be tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:58.147975 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a6ea45db-31a1-4266-9456-4d1554b349be tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:58.148965 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a6ea45db-31a1-4266-9456-4d1554b349be tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:58.149578 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a6ea45db-31a1-4266-9456-4d1554b349be tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:58.286941 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-9680f927-960a-4299-88bd-8021a8c83168 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:58.294823 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-9680f927-960a-4299-88bd-8021a8c83168 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.162044 May 09 23:03:58.295736 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 92/186] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:58 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:58.301915 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a6ea45db-31a1-4266-9456-4d1554b349be tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:58.310627 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a6ea45db-31a1-4266-9456-4d1554b349be tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:58.312676 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a6ea45db-31a1-4266-9456-4d1554b349be tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:58.314074 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a6ea45db-31a1-4266-9456-4d1554b349be tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1406 microversion: 2.20 time: 0.177932 May 09 23:03:58.314502 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 95/187] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:03:58 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:03:59.073824 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6b8dd7a6-4574-4699-83af-6e26bb457277 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:59.074579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6b8dd7a6-4574-4699-83af-6e26bb457277 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:59.080435 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6b8dd7a6-4574-4699-83af-6e26bb457277 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:59.080883 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6b8dd7a6-4574-4699-83af-6e26bb457277 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:59.081650 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6b8dd7a6-4574-4699-83af-6e26bb457277 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:59.082083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6b8dd7a6-4574-4699-83af-6e26bb457277 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:59.227500 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6b8dd7a6-4574-4699-83af-6e26bb457277 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:59.237974 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6b8dd7a6-4574-4699-83af-6e26bb457277 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1314 microversion: 2.1 time: 0.167893 May 09 23:03:59.238576 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 93/188] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:59 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:59.311860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-4a4cdfbb-5005-4464-8701-9f4a320a04e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:59.312480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-4a4cdfbb-5005-4464-8701-9f4a320a04e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:59.319024 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4a4cdfbb-5005-4464-8701-9f4a320a04e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:59.319478 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4a4cdfbb-5005-4464-8701-9f4a320a04e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:59.320246 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4a4cdfbb-5005-4464-8701-9f4a320a04e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:59.320681 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4a4cdfbb-5005-4464-8701-9f4a320a04e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:59.332593 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b0bd0bbd-a0a1-473d-b187-d5e50ad028e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:03:59.333341 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b0bd0bbd-a0a1-473d-b187-d5e50ad028e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:03:59.341008 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b0bd0bbd-a0a1-473d-b187-d5e50ad028e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:59.341707 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b0bd0bbd-a0a1-473d-b187-d5e50ad028e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:59.343700 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b0bd0bbd-a0a1-473d-b187-d5e50ad028e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:03:59.344351 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b0bd0bbd-a0a1-473d-b187-d5e50ad028e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:03:59.475651 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-4a4cdfbb-5005-4464-8701-9f4a320a04e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:59.483522 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-4a4cdfbb-5005-4464-8701-9f4a320a04e4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.175849 May 09 23:03:59.484042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 96/189] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:03:59 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:03:59.489032 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b0bd0bbd-a0a1-473d-b187-d5e50ad028e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:59.496925 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b0bd0bbd-a0a1-473d-b187-d5e50ad028e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:59.498455 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b0bd0bbd-a0a1-473d-b187-d5e50ad028e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:03:59.500094 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b0bd0bbd-a0a1-473d-b187-d5e50ad028e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1406 microversion: 2.20 time: 0.171876 May 09 23:03:59.500644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 94/190] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:03:59 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:04:00.254907 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ceb9ec70-44fa-42c6-934b-ce0e98ff26a7 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:00.255509 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ceb9ec70-44fa-42c6-934b-ce0e98ff26a7 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:00.261341 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ceb9ec70-44fa-42c6-934b-ce0e98ff26a7 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:00.261784 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ceb9ec70-44fa-42c6-934b-ce0e98ff26a7 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:00.262605 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ceb9ec70-44fa-42c6-934b-ce0e98ff26a7 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:00.263039 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ceb9ec70-44fa-42c6-934b-ce0e98ff26a7 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:00.389231 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ceb9ec70-44fa-42c6-934b-ce0e98ff26a7 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:00.396840 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ceb9ec70-44fa-42c6-934b-ce0e98ff26a7 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1463 microversion: 2.1 time: 0.145771 May 09 23:04:00.397305 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 97/191] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:00 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1463 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:00.440473 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ff623ede-41ef-4306-aced-27720eb3ff9a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:00.440988 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ff623ede-41ef-4306-aced-27720eb3ff9a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:00.448078 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ff623ede-41ef-4306-aced-27720eb3ff9a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:00.448791 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ff623ede-41ef-4306-aced-27720eb3ff9a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:00.450231 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ff623ede-41ef-4306-aced-27720eb3ff9a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:00.450890 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ff623ede-41ef-4306-aced-27720eb3ff9a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:00.478364 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ff623ede-41ef-4306-aced-27720eb3ff9a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Going to try to terminate instance {{(pid=117143) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:04:00.500357 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fa2e414d-9a50-4ee6-9a4d-7b448023649c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:00.501204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-fa2e414d-9a50-4ee6-9a4d-7b448023649c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:00.507283 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fa2e414d-9a50-4ee6-9a4d-7b448023649c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:00.507758 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fa2e414d-9a50-4ee6-9a4d-7b448023649c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:00.508631 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fa2e414d-9a50-4ee6-9a4d-7b448023649c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:00.509066 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fa2e414d-9a50-4ee6-9a4d-7b448023649c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:00.562071 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ff623ede-41ef-4306-aced-27720eb3ff9a tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 204 len: 0 microversion: 2.1 time: 0.125163 May 09 23:04:00.562972 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 95/192] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:04:00 2022] DELETE /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:04:00.568393 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-894658bd-022e-4434-be6e-d0e2b515453c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:00.569082 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-894658bd-022e-4434-be6e-d0e2b515453c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:00.574802 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-894658bd-022e-4434-be6e-d0e2b515453c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:00.575247 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-894658bd-022e-4434-be6e-d0e2b515453c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:00.576008 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-894658bd-022e-4434-be6e-d0e2b515453c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:00.576438 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-894658bd-022e-4434-be6e-d0e2b515453c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:00.646543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-fa2e414d-9a50-4ee6-9a4d-7b448023649c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:00.653790 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-fa2e414d-9a50-4ee6-9a4d-7b448023649c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.157292 May 09 23:04:00.654512 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 98/193] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:00 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:00.659416 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-dc7f2961-a088-44f1-9007-82682ef71fe0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:00.660012 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-dc7f2961-a088-44f1-9007-82682ef71fe0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:00.665511 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-dc7f2961-a088-44f1-9007-82682ef71fe0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:00.665950 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-dc7f2961-a088-44f1-9007-82682ef71fe0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:00.666741 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-dc7f2961-a088-44f1-9007-82682ef71fe0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:00.667173 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-dc7f2961-a088-44f1-9007-82682ef71fe0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:00.710698 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-894658bd-022e-4434-be6e-d0e2b515453c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:00.718787 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-894658bd-022e-4434-be6e-d0e2b515453c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:00.720306 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-894658bd-022e-4434-be6e-d0e2b515453c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:00.721411 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-894658bd-022e-4434-be6e-d0e2b515453c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1406 microversion: 2.20 time: 0.157301 May 09 23:04:00.721978 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 96/194] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:04:00 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:04:00.800158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-dc7f2961-a088-44f1-9007-82682ef71fe0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:00.809784 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-dc7f2961-a088-44f1-9007-82682ef71fe0 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1469 microversion: 2.1 time: 0.153645 May 09 23:04:00.810542 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 99/195] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:00 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:01.671179 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-426204e8-5dd8-42e8-ba4c-afa3b12b8676 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:01.671633 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-426204e8-5dd8-42e8-ba4c-afa3b12b8676 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:01.677931 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-426204e8-5dd8-42e8-ba4c-afa3b12b8676 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:01.678410 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-426204e8-5dd8-42e8-ba4c-afa3b12b8676 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:01.679178 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-426204e8-5dd8-42e8-ba4c-afa3b12b8676 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:01.679603 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-426204e8-5dd8-42e8-ba4c-afa3b12b8676 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:01.740309 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-eb769d42-9357-40b8-8b93-67add7767105 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:01.740824 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-eb769d42-9357-40b8-8b93-67add7767105 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:01.746994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eb769d42-9357-40b8-8b93-67add7767105 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:01.747445 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eb769d42-9357-40b8-8b93-67add7767105 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:01.749081 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eb769d42-9357-40b8-8b93-67add7767105 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:01.749528 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eb769d42-9357-40b8-8b93-67add7767105 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:01.812962 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-426204e8-5dd8-42e8-ba4c-afa3b12b8676 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:01.821246 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-426204e8-5dd8-42e8-ba4c-afa3b12b8676 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.154064 May 09 23:04:01.822383 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 97/196] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:01 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:01.828473 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-dce39b5e-6706-4cce-99a8-5f5126a83e31 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:01.829289 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-dce39b5e-6706-4cce-99a8-5f5126a83e31 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:01.835896 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dce39b5e-6706-4cce-99a8-5f5126a83e31 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:01.836511 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dce39b5e-6706-4cce-99a8-5f5126a83e31 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:01.837424 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dce39b5e-6706-4cce-99a8-5f5126a83e31 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:01.838286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dce39b5e-6706-4cce-99a8-5f5126a83e31 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:01.895297 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-eb769d42-9357-40b8-8b93-67add7767105 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:01.903479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-eb769d42-9357-40b8-8b93-67add7767105 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:01.905412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-eb769d42-9357-40b8-8b93-67add7767105 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:01.906536 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-eb769d42-9357-40b8-8b93-67add7767105 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1406 microversion: 2.20 time: 0.170245 May 09 23:04:01.907372 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 100/197] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:04:01 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:04:01.975614 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-dce39b5e-6706-4cce-99a8-5f5126a83e31 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:01.983810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-dce39b5e-6706-4cce-99a8-5f5126a83e31 tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1469 microversion: 2.1 time: 0.159448 May 09 23:04:01.984376 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 98/198] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:01 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:02.228205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-07f1a4f2-7ad9-4ba5-89cb-2743d7e8b2be req-88e75f59-c347-4e87-a2db-cdf7d6afc5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5734d5-da65-4ee8-8684-e236f56da50a", "name": "network-vif-plugged", "status": "completed", "tag": "9b2aff87-eeca-44a4-b616-becbcd5f1d58"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:02.240847 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-07f1a4f2-7ad9-4ba5-89cb-2743d7e8b2be req-88e75f59-c347-4e87-a2db-cdf7d6afc5ae service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:02.241696 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-07f1a4f2-7ad9-4ba5-89cb-2743d7e8b2be req-88e75f59-c347-4e87-a2db-cdf7d6afc5ae service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:02.262906 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-07f1a4f2-7ad9-4ba5-89cb-2743d7e8b2be req-88e75f59-c347-4e87-a2db-cdf7d6afc5ae service nova] Creating event network-vif-plugged:9b2aff87-eeca-44a4-b616-becbcd5f1d58 for instance 2e5734d5-da65-4ee8-8684-e236f56da50a on hv-cinder-84067 May 09 23:04:02.281236 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-07f1a4f2-7ad9-4ba5-89cb-2743d7e8b2be req-88e75f59-c347-4e87-a2db-cdf7d6afc5ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058651 May 09 23:04:02.282361 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 101/199] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:04:02.839108 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-48b7fb0b-209f-4a4e-a97a-a030ba62c645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:02.840372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-48b7fb0b-209f-4a4e-a97a-a030ba62c645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:02.849684 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-48b7fb0b-209f-4a4e-a97a-a030ba62c645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:02.850147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-48b7fb0b-209f-4a4e-a97a-a030ba62c645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:02.851097 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-48b7fb0b-209f-4a4e-a97a-a030ba62c645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:02.851576 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-48b7fb0b-209f-4a4e-a97a-a030ba62c645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:02.926284 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c3135fbc-6127-431e-bae4-d58ccc85e396 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:02.927071 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c3135fbc-6127-431e-bae4-d58ccc85e396 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:02.934719 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c3135fbc-6127-431e-bae4-d58ccc85e396 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:02.935588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c3135fbc-6127-431e-bae4-d58ccc85e396 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:02.936702 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c3135fbc-6127-431e-bae4-d58ccc85e396 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:02.937321 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c3135fbc-6127-431e-bae4-d58ccc85e396 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:03.040006 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-48b7fb0b-209f-4a4e-a97a-a030ba62c645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:03.048541 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-48b7fb0b-209f-4a4e-a97a-a030ba62c645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1523 microversion: 2.1 time: 0.213299 May 09 23:04:03.049135 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 99/200] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:02 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:03.062617 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-41c79754-bbf1-4acf-9a95-b651a8385afb tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:03.063261 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-41c79754-bbf1-4acf-9a95-b651a8385afb tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:03.069584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-41c79754-bbf1-4acf-9a95-b651a8385afb tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:03.070134 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-41c79754-bbf1-4acf-9a95-b651a8385afb tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:03.071012 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-41c79754-bbf1-4acf-9a95-b651a8385afb tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:03.071539 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-41c79754-bbf1-4acf-9a95-b651a8385afb tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:03.143701 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-41c79754-bbf1-4acf-9a95-b651a8385afb tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:03.152499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-41c79754-bbf1-4acf-9a95-b651a8385afb tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1427 microversion: 2.1 time: 0.102164 May 09 23:04:03.153382 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 100/201] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:03 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:03.158734 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-1278837d-f346-4001-a369-7fcd096dc4ca req-66b811cc-3f86-4fa3-a019-238ec10a499f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77bb953a-1e2c-4c3b-a4cb-f21a9b87c493", "name": "network-vif-deleted", "tag": "1cbdddf0-c2b1-47df-b760-5d077761c252"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:03.167941 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-1278837d-f346-4001-a369-7fcd096dc4ca req-66b811cc-3f86-4fa3-a019-238ec10a499f service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:03.168519 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-1278837d-f346-4001-a369-7fcd096dc4ca req-66b811cc-3f86-4fa3-a019-238ec10a499f service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:03.180419 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-1278837d-f346-4001-a369-7fcd096dc4ca req-66b811cc-3f86-4fa3-a019-238ec10a499f service nova] Creating event network-vif-deleted:1cbdddf0-c2b1-47df-b760-5d077761c252 for instance 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 on hv-cinder-84067 May 09 23:04:03.181734 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c3135fbc-6127-431e-bae4-d58ccc85e396 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:03.185582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-1278837d-f346-4001-a369-7fcd096dc4ca req-66b811cc-3f86-4fa3-a019-238ec10a499f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030962 May 09 23:04:03.186823 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 101/202] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:04:03.190045 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c3135fbc-6127-431e-bae4-d58ccc85e396 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:03.191600 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c3135fbc-6127-431e-bae4-d58ccc85e396 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:03.192718 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c3135fbc-6127-431e-bae4-d58ccc85e396 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1406 microversion: 2.20 time: 0.271749 May 09 23:04:03.197778 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 102/203] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:04:02 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1406 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:04:04.066542 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6f6710b4-5232-4843-aa1a-8fa37dda80ed tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:04.067247 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6f6710b4-5232-4843-aa1a-8fa37dda80ed tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:04.073336 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6f6710b4-5232-4843-aa1a-8fa37dda80ed tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:04.073839 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6f6710b4-5232-4843-aa1a-8fa37dda80ed tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:04.074651 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6f6710b4-5232-4843-aa1a-8fa37dda80ed tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:04.075090 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6f6710b4-5232-4843-aa1a-8fa37dda80ed tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:04.172129 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5109c5f2-0470-4746-b16a-a93bc74ff58c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:04.172736 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5109c5f2-0470-4746-b16a-a93bc74ff58c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:04.178441 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5109c5f2-0470-4746-b16a-a93bc74ff58c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:04.178883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5109c5f2-0470-4746-b16a-a93bc74ff58c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:04.179650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5109c5f2-0470-4746-b16a-a93bc74ff58c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:04.180079 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5109c5f2-0470-4746-b16a-a93bc74ff58c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:04.221558 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6f6710b4-5232-4843-aa1a-8fa37dda80ed tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:04.228335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6f6710b4-5232-4843-aa1a-8fa37dda80ed tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1503 microversion: 2.1 time: 0.166477 May 09 23:04:04.228926 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 102/204] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:04 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:04.241158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0b8bbe97-227e-40a7-b840-aaec8fbcd3c0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:04.242082 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-0b8bbe97-227e-40a7-b840-aaec8fbcd3c0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:04.246236 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5109c5f2-0470-4746-b16a-a93bc74ff58c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:04.248304 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0b8bbe97-227e-40a7-b840-aaec8fbcd3c0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:04.248823 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0b8bbe97-227e-40a7-b840-aaec8fbcd3c0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:04.249778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0b8bbe97-227e-40a7-b840-aaec8fbcd3c0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:04.250382 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0b8bbe97-227e-40a7-b840-aaec8fbcd3c0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:04.255522 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5109c5f2-0470-4746-b16a-a93bc74ff58c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1299 microversion: 2.1 time: 0.087795 May 09 23:04:04.256607 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 103/205] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:04 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:04.261365 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ed7a4a7d-c878-4e48-bdcb-1dee72bea548 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:04.262044 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ed7a4a7d-c878-4e48-bdcb-1dee72bea548 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:04.269316 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ed7a4a7d-c878-4e48-bdcb-1dee72bea548 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:04.270437 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ed7a4a7d-c878-4e48-bdcb-1dee72bea548 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:04.271486 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ed7a4a7d-c878-4e48-bdcb-1dee72bea548 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:04.271998 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ed7a4a7d-c878-4e48-bdcb-1dee72bea548 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:04.385855 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-0b8bbe97-227e-40a7-b840-aaec8fbcd3c0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:04.394274 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-0b8bbe97-227e-40a7-b840-aaec8fbcd3c0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:04.395809 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-0b8bbe97-227e-40a7-b840-aaec8fbcd3c0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:04.396914 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-0b8bbe97-227e-40a7-b840-aaec8fbcd3c0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1406 microversion: 2.20 time: 0.167081 May 09 23:04:04.397821 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 103/206] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:04:04 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:04:04.422701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ed7a4a7d-c878-4e48-bdcb-1dee72bea548 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:04.429876 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ed7a4a7d-c878-4e48-bdcb-1dee72bea548 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1515 microversion: 2.1 time: 0.172163 May 09 23:04:04.430476 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 104/207] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:04 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:05.272631 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-507fcf5a-d548-4b52-95be-93102a467d3c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:05.273308 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-507fcf5a-d548-4b52-95be-93102a467d3c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:05.280225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-507fcf5a-d548-4b52-95be-93102a467d3c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:05.280709 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-507fcf5a-d548-4b52-95be-93102a467d3c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:05.281480 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-507fcf5a-d548-4b52-95be-93102a467d3c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:05.281916 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-507fcf5a-d548-4b52-95be-93102a467d3c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:05.311807 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-507fcf5a-d548-4b52-95be-93102a467d3c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:05.312251 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-507fcf5a-d548-4b52-95be-93102a467d3c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:05.312695 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.objects.instance [None req-507fcf5a-d548-4b52-95be-93102a467d3c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lazy-loading 'fault' on Instance uuid 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 {{(pid=117143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:04:05.359018 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-507fcf5a-d548-4b52-95be-93102a467d3c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:05.366351 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-507fcf5a-d548-4b52-95be-93102a467d3c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1304 microversion: 2.1 time: 0.097524 May 09 23:04:05.366930 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 104/208] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:05 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:05.415605 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ed67a69f-aa57-4424-bf53-bc845c1c6d5c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:05.416368 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ed67a69f-aa57-4424-bf53-bc845c1c6d5c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:05.422175 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ed67a69f-aa57-4424-bf53-bc845c1c6d5c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:05.422660 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ed67a69f-aa57-4424-bf53-bc845c1c6d5c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:05.423434 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ed67a69f-aa57-4424-bf53-bc845c1c6d5c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:05.423874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ed67a69f-aa57-4424-bf53-bc845c1c6d5c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:05.548820 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ed67a69f-aa57-4424-bf53-bc845c1c6d5c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:05.556595 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ed67a69f-aa57-4424-bf53-bc845c1c6d5c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:05.558106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ed67a69f-aa57-4424-bf53-bc845c1c6d5c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:05.559232 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ed67a69f-aa57-4424-bf53-bc845c1c6d5c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1406 microversion: 2.20 time: 0.147962 May 09 23:04:05.559795 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 105/209] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:04:05 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:04:06.382769 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b5ff46c4-f770-48e7-b48e-1133da964a8c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:06.383387 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b5ff46c4-f770-48e7-b48e-1133da964a8c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:06.389693 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b5ff46c4-f770-48e7-b48e-1133da964a8c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:06.390172 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b5ff46c4-f770-48e7-b48e-1133da964a8c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:06.390953 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b5ff46c4-f770-48e7-b48e-1133da964a8c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:06.391389 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b5ff46c4-f770-48e7-b48e-1133da964a8c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:06.421861 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b5ff46c4-f770-48e7-b48e-1133da964a8c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:06.422342 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b5ff46c4-f770-48e7-b48e-1133da964a8c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:06.422795 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.objects.instance [None req-b5ff46c4-f770-48e7-b48e-1133da964a8c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lazy-loading 'fault' on Instance uuid 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 {{(pid=117143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:04:06.460809 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b5ff46c4-f770-48e7-b48e-1133da964a8c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:06.468428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b5ff46c4-f770-48e7-b48e-1133da964a8c tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1304 microversion: 2.1 time: 0.089572 May 09 23:04:06.469009 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 105/210] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:06 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:06.577460 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9b3a79be-3ef7-4545-85cc-9436b0680250 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:06.578068 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9b3a79be-3ef7-4545-85cc-9436b0680250 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:06.583853 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9b3a79be-3ef7-4545-85cc-9436b0680250 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:06.584303 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9b3a79be-3ef7-4545-85cc-9436b0680250 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:06.585071 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9b3a79be-3ef7-4545-85cc-9436b0680250 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:06.585506 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9b3a79be-3ef7-4545-85cc-9436b0680250 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:06.710734 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-9b3a79be-3ef7-4545-85cc-9436b0680250 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:06.718961 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-9b3a79be-3ef7-4545-85cc-9436b0680250 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:06.720461 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-9b3a79be-3ef7-4545-85cc-9436b0680250 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:06.721555 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9b3a79be-3ef7-4545-85cc-9436b0680250 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1406 microversion: 2.20 time: 0.148062 May 09 23:04:06.722136 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 106/211] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:04:06 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:04:07.485693 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ad2dc9dd-be18-4400-9150-c5b2a0730a8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:07.486329 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ad2dc9dd-be18-4400-9150-c5b2a0730a8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:07.492753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad2dc9dd-be18-4400-9150-c5b2a0730a8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:07.493195 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad2dc9dd-be18-4400-9150-c5b2a0730a8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:07.494012 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad2dc9dd-be18-4400-9150-c5b2a0730a8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:07.494423 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad2dc9dd-be18-4400-9150-c5b2a0730a8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:07.527792 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad2dc9dd-be18-4400-9150-c5b2a0730a8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:07.528231 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad2dc9dd-be18-4400-9150-c5b2a0730a8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:07.528674 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.objects.instance [None req-ad2dc9dd-be18-4400-9150-c5b2a0730a8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lazy-loading 'fault' on Instance uuid 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 {{(pid=117143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:04:07.573188 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ad2dc9dd-be18-4400-9150-c5b2a0730a8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9a151d58eb4c8a8e99c1e35e6723f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbf3360a1654ddbbc5812f5ea706eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:07.582852 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ad2dc9dd-be18-4400-9150-c5b2a0730a8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 200 len: 1304 microversion: 2.1 time: 0.101828 May 09 23:04:07.583578 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 106/212] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:07 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:07.739292 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-93e5996c-049c-4237-bae0-7e7413fbec3d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:07.739901 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-93e5996c-049c-4237-bae0-7e7413fbec3d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:07.745792 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-93e5996c-049c-4237-bae0-7e7413fbec3d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:07.746219 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-93e5996c-049c-4237-bae0-7e7413fbec3d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:07.746994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-93e5996c-049c-4237-bae0-7e7413fbec3d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:07.747430 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-93e5996c-049c-4237-bae0-7e7413fbec3d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:07.864578 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-348627da-1a5f-4802-99d7-204ecc6d4f94 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:07.865568 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-348627da-1a5f-4802-99d7-204ecc6d4f94 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:07.871349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-348627da-1a5f-4802-99d7-204ecc6d4f94 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:07.871799 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-348627da-1a5f-4802-99d7-204ecc6d4f94 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:07.872570 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-348627da-1a5f-4802-99d7-204ecc6d4f94 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:07.872999 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-348627da-1a5f-4802-99d7-204ecc6d4f94 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:07.877789 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-93e5996c-049c-4237-bae0-7e7413fbec3d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:07.885536 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-93e5996c-049c-4237-bae0-7e7413fbec3d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:07.887076 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-93e5996c-049c-4237-bae0-7e7413fbec3d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:07.888235 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-93e5996c-049c-4237-bae0-7e7413fbec3d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1599 microversion: 2.20 time: 0.152899 May 09 23:04:07.888810 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 107/213] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:04:07 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:04:07.896910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.objects.instance [None req-348627da-1a5f-4802-99d7-204ecc6d4f94 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lazy-loading 'flavor' on Instance uuid ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 {{(pid=117143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:04:07.907546 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-b34d6c78-a756-4cdd-a2d6-ed25c0a28821 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:07.909859 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-b34d6c78-a756-4cdd-a2d6-ed25c0a28821 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:07.916353 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b34d6c78-a756-4cdd-a2d6-ed25c0a28821 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:07.916804 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b34d6c78-a756-4cdd-a2d6-ed25c0a28821 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:07.917589 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b34d6c78-a756-4cdd-a2d6-ed25c0a28821 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:07.918026 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b34d6c78-a756-4cdd-a2d6-ed25c0a28821 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:07.973355 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-348627da-1a5f-4802-99d7-204ecc6d4f94 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "POST /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7/action" status: 200 len: 32 microversion: 2.1 time: 0.112675 May 09 23:04:07.974254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 107/214] 10.222.0.23 () {60 vars in 1277 bytes} [Mon May 9 23:04:07 2022] POST /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7/action => generated 32 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 09 23:04:07.987343 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d3c0aa31-2faf-4a05-a4f2-4d4674252c6a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:07.988053 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d3c0aa31-2faf-4a05-a4f2-4d4674252c6a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:07.994512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d3c0aa31-2faf-4a05-a4f2-4d4674252c6a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:07.994962 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d3c0aa31-2faf-4a05-a4f2-4d4674252c6a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:07.995872 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d3c0aa31-2faf-4a05-a4f2-4d4674252c6a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:07.996246 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d3c0aa31-2faf-4a05-a4f2-4d4674252c6a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:07.997741 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-b34d6c78-a756-4cdd-a2d6-ed25c0a28821 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096071 May 09 23:04:08.004759 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 108/215] 10.222.0.23 () {60 vars in 1315 bytes} [Mon May 9 23:04:07 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 23:04:08.214411 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d3c0aa31-2faf-4a05-a4f2-4d4674252c6a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:08.223806 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d3c0aa31-2faf-4a05-a4f2-4d4674252c6a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.243234 May 09 23:04:08.233782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 108/216] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:07 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:08.599962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-73cadd81-68d3-4bc6-a0de-fa11a5ac5d8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:08.600588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-73cadd81-68d3-4bc6-a0de-fa11a5ac5d8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] [instance: 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:08.607526 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-73cadd81-68d3-4bc6-a0de-fa11a5ac5d8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:08.608010 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-73cadd81-68d3-4bc6-a0de-fa11a5ac5d8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:08.609004 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-73cadd81-68d3-4bc6-a0de-fa11a5ac5d8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:08.609599 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-73cadd81-68d3-4bc6-a0de-fa11a5ac5d8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:08.627260 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-73cadd81-68d3-4bc6-a0de-fa11a5ac5d8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] HTTP exception thrown: Instance 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 could not be found. May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-73cadd81-68d3-4bc6-a0de-fa11a5ac5d8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Request method failure captured: May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 HTTP/1.1 May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ3HmOmDp7lrOgT6DhB6P63zOULH9DaJW3K2T3yh5dJXpynIo4LGCQ70cgkSIBob9Auuqit3OOs4fNuXTYPW0Tmsca9s1LQr7Gsi8S4x9aTCX3VkBvbt6JP-0IQ0DE3MwGgFbV9MrMg7_dvx0BEqcsh8Ol_8wV36P-Fy_cdTMyD4zsA May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: fcbf3360a1654ddbbc5812f5ea706eb6 May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-VolumesNegativeTest-1426882639 May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:04:08.629335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:04:08.630962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fcbf3360a1654ddbbc5812f5ea706eb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fcbf3360a1654ddbbc5812f5ea706eb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fcbf3360a1654ddbbc5812f5ea706eb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fcbf3360a1654ddbbc5812f5ea706eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:04:08.630962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-VolumesNegativeTest-1426882639 May 09 23:04:08.630962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: fcbf3360a1654ddbbc5812f5ea706eb6 May 09 23:04:08.630962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-VolumesNegativeTest-1426882639 May 09 23:04:08.630962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-VolumesNegativeTest-1426882639-project May 09 23:04:08.630962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:04:08.630962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:04:08.630962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 0f9a151d58eb4c8a8e99c1e35e6723f6 May 09 23:04:08.630962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-VolumesNegativeTest-1426882639-project May 09 23:04:08.630962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:04:08.630962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 could not be found. May 09 23:04:08.630962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '77bb953a-1e2c-4c3b-a4cb-f21a9b87c493'} May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 could not be found. May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:04:08.631811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 could not be found. May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 could not be found. May 09 23:04:08.633233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:04:08.635116 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-73cadd81-68d3-4bc6-a0de-fa11a5ac5d8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] Returning 404 to user: Instance 77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:04:08.636103 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-73cadd81-68d3-4bc6-a0de-fa11a5ac5d8d tempest-VolumesNegativeTest-1426882639 tempest-VolumesNegativeTest-1426882639-project] 10.222.0.23 "GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493" status: 404 len: 111 microversion: 2.1 time: 0.040085 May 09 23:04:08.636772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 109/217] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:08 2022] GET /compute/v2.1/servers/77bb953a-1e2c-4c3b-a4cb-f21a9b87c493 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:04:09.241628 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-fbd9540a-cc45-479f-9cad-8cef5ca4c4c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:09.242390 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-fbd9540a-cc45-479f-9cad-8cef5ca4c4c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:09.264048 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fbd9540a-cc45-479f-9cad-8cef5ca4c4c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:09.265445 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fbd9540a-cc45-479f-9cad-8cef5ca4c4c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:09.266486 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fbd9540a-cc45-479f-9cad-8cef5ca4c4c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:09.267168 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fbd9540a-cc45-479f-9cad-8cef5ca4c4c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:09.572110 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-fbd9540a-cc45-479f-9cad-8cef5ca4c4c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:09.584662 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-fbd9540a-cc45-479f-9cad-8cef5ca4c4c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.345929 May 09 23:04:09.590165 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 109/218] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:09 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:09.883939 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-95c4d48b-3096-497f-b472-b2c44602be2e req-abfce13b-ea91-45a0-967b-6bb1e78bcc21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5734d5-da65-4ee8-8684-e236f56da50a", "tag": "9b2aff87-eeca-44a4-b616-becbcd5f1d58"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:09.896310 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-95c4d48b-3096-497f-b472-b2c44602be2e req-abfce13b-ea91-45a0-967b-6bb1e78bcc21 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:09.896756 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-95c4d48b-3096-497f-b472-b2c44602be2e req-abfce13b-ea91-45a0-967b-6bb1e78bcc21 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:09.919879 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-95c4d48b-3096-497f-b472-b2c44602be2e req-abfce13b-ea91-45a0-967b-6bb1e78bcc21 service nova] Creating event network-changed:9b2aff87-eeca-44a4-b616-becbcd5f1d58 for instance 2e5734d5-da65-4ee8-8684-e236f56da50a on hv-cinder-84067 May 09 23:04:09.927480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-95c4d48b-3096-497f-b472-b2c44602be2e req-abfce13b-ea91-45a0-967b-6bb1e78bcc21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047132 May 09 23:04:09.933481 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 110/219] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:04:10.605623 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-9adf4340-089c-43de-8a25-1a33af84fe1c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:10.606275 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-9adf4340-089c-43de-8a25-1a33af84fe1c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:10.628233 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9adf4340-089c-43de-8a25-1a33af84fe1c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:10.628680 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9adf4340-089c-43de-8a25-1a33af84fe1c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:10.630244 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9adf4340-089c-43de-8a25-1a33af84fe1c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:10.630244 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9adf4340-089c-43de-8a25-1a33af84fe1c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:10.952812 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-9adf4340-089c-43de-8a25-1a33af84fe1c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:10.961284 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-9adf4340-089c-43de-8a25-1a33af84fe1c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.361100 May 09 23:04:10.962056 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 110/220] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:10 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:11.983892 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e70b82ed-c7db-4687-a9df-2e9a3ca998c9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:11.984686 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e70b82ed-c7db-4687-a9df-2e9a3ca998c9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:12.001556 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e70b82ed-c7db-4687-a9df-2e9a3ca998c9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:12.002022 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e70b82ed-c7db-4687-a9df-2e9a3ca998c9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:12.002847 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e70b82ed-c7db-4687-a9df-2e9a3ca998c9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:12.003298 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e70b82ed-c7db-4687-a9df-2e9a3ca998c9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:12.303632 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e70b82ed-c7db-4687-a9df-2e9a3ca998c9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:12.312346 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e70b82ed-c7db-4687-a9df-2e9a3ca998c9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.337518 May 09 23:04:12.312961 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 111/221] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:11 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:13.330390 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b808209a-7b72-42dc-9036-6ae921a7b8e8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:13.330998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b808209a-7b72-42dc-9036-6ae921a7b8e8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:13.346292 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b808209a-7b72-42dc-9036-6ae921a7b8e8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:13.346753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b808209a-7b72-42dc-9036-6ae921a7b8e8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:13.347563 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b808209a-7b72-42dc-9036-6ae921a7b8e8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:13.348173 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b808209a-7b72-42dc-9036-6ae921a7b8e8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:13.687367 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b808209a-7b72-42dc-9036-6ae921a7b8e8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:13.697546 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b808209a-7b72-42dc-9036-6ae921a7b8e8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.371387 May 09 23:04:13.708533 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 111/222] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:13 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:14.717871 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5725e826-018f-403d-9229-788fa3cc6a47 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:14.721327 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5725e826-018f-403d-9229-788fa3cc6a47 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:14.735514 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5725e826-018f-403d-9229-788fa3cc6a47 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:14.736338 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5725e826-018f-403d-9229-788fa3cc6a47 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:14.737900 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5725e826-018f-403d-9229-788fa3cc6a47 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:14.738756 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5725e826-018f-403d-9229-788fa3cc6a47 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:14.979959 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5725e826-018f-403d-9229-788fa3cc6a47 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:14.999370 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5725e826-018f-403d-9229-788fa3cc6a47 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.285733 May 09 23:04:15.000115 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 112/223] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:14 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:16.031322 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-40445152-dc17-4367-ba30-e05b7b9ccee0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:16.032171 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-40445152-dc17-4367-ba30-e05b7b9ccee0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:16.046708 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-40445152-dc17-4367-ba30-e05b7b9ccee0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:16.047595 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-40445152-dc17-4367-ba30-e05b7b9ccee0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:16.050291 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-40445152-dc17-4367-ba30-e05b7b9ccee0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:16.056241 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-40445152-dc17-4367-ba30-e05b7b9ccee0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:16.273192 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-40445152-dc17-4367-ba30-e05b7b9ccee0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:16.281910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-40445152-dc17-4367-ba30-e05b7b9ccee0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.255939 May 09 23:04:16.282521 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 112/224] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:16 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:16.457737 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5c2997f1-9a4e-4b5d-a108-383162f0865b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:16.461913 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5c2997f1-9a4e-4b5d-a108-383162f0865b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:16.468960 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5c2997f1-9a4e-4b5d-a108-383162f0865b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:16.469701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5c2997f1-9a4e-4b5d-a108-383162f0865b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:16.470718 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5c2997f1-9a4e-4b5d-a108-383162f0865b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:16.471349 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5c2997f1-9a4e-4b5d-a108-383162f0865b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:16.496516 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5c2997f1-9a4e-4b5d-a108-383162f0865b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/ips" status: 200 len: 151 microversion: 2.1 time: 0.042485 May 09 23:04:16.497346 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 113/225] 10.222.0.23 () {58 vars in 1247 bytes} [Mon May 9 23:04:16 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:04:17.299780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ed97a3ce-6149-4bdb-bcbb-3f3cc3ec36a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:17.300410 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ed97a3ce-6149-4bdb-bcbb-3f3cc3ec36a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:17.311985 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ed97a3ce-6149-4bdb-bcbb-3f3cc3ec36a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:17.312433 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ed97a3ce-6149-4bdb-bcbb-3f3cc3ec36a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:17.313229 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ed97a3ce-6149-4bdb-bcbb-3f3cc3ec36a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:17.316168 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ed97a3ce-6149-4bdb-bcbb-3f3cc3ec36a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:17.566354 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ed97a3ce-6149-4bdb-bcbb-3f3cc3ec36a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:17.577448 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ed97a3ce-6149-4bdb-bcbb-3f3cc3ec36a7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.282908 May 09 23:04:17.578423 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 113/226] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:17 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:17.943194 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cf9adc1a-558d-41e6-8482-24611bbe3f79 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be04a6c4-9386-49f4-8c57-c37ff92dce7f"}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:17.944969 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cf9adc1a-558d-41e6-8482-24611bbe3f79 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:17.952705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf9adc1a-558d-41e6-8482-24611bbe3f79 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:17.956101 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf9adc1a-558d-41e6-8482-24611bbe3f79 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:17.963496 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf9adc1a-558d-41e6-8482-24611bbe3f79 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:17.971087 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf9adc1a-558d-41e6-8482-24611bbe3f79 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:18.612932 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-763c8498-ced6-4bcc-8428-63e593e03e21 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:18.617941 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-763c8498-ced6-4bcc-8428-63e593e03e21 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:18.651918 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-763c8498-ced6-4bcc-8428-63e593e03e21 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:18.652381 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-763c8498-ced6-4bcc-8428-63e593e03e21 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:18.656171 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-763c8498-ced6-4bcc-8428-63e593e03e21 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:18.656677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-763c8498-ced6-4bcc-8428-63e593e03e21 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:18.787892 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cf9adc1a-558d-41e6-8482-24611bbe3f79 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "POST /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.848105 May 09 23:04:18.789511 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 114/227] 10.222.0.23 () {60 vars in 1322 bytes} [Mon May 9 23:04:17 2022] POST /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments => generated 194 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:04:18.928239 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-763c8498-ced6-4bcc-8428-63e593e03e21 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:18.936478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-763c8498-ced6-4bcc-8428-63e593e03e21 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.345288 May 09 23:04:18.937150 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 114/228] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:18 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:19.955657 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-93662735-fdc8-41dc-9d49-39461ea0eed5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:19.957174 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-93662735-fdc8-41dc-9d49-39461ea0eed5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:19.970552 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-93662735-fdc8-41dc-9d49-39461ea0eed5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:19.971327 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-93662735-fdc8-41dc-9d49-39461ea0eed5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:19.976800 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-93662735-fdc8-41dc-9d49-39461ea0eed5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:19.979021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-93662735-fdc8-41dc-9d49-39461ea0eed5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:20.215466 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-93662735-fdc8-41dc-9d49-39461ea0eed5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:20.227573 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-93662735-fdc8-41dc-9d49-39461ea0eed5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.278516 May 09 23:04:20.228401 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 115/229] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:19 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:21.246305 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-df4282a3-da3d-46ac-a9d0-b623192e6d58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:21.246924 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-df4282a3-da3d-46ac-a9d0-b623192e6d58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:21.278644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-df4282a3-da3d-46ac-a9d0-b623192e6d58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:21.279119 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-df4282a3-da3d-46ac-a9d0-b623192e6d58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:21.283598 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-df4282a3-da3d-46ac-a9d0-b623192e6d58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:21.284054 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-df4282a3-da3d-46ac-a9d0-b623192e6d58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:21.681317 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-df4282a3-da3d-46ac-a9d0-b623192e6d58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:21.706364 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-df4282a3-da3d-46ac-a9d0-b623192e6d58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.464268 May 09 23:04:21.708818 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 115/230] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:21 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:22.730598 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d40f0628-a929-4953-bed1-4778aba9d14e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:22.733483 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-d40f0628-a929-4953-bed1-4778aba9d14e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:22.751866 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d40f0628-a929-4953-bed1-4778aba9d14e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:22.752324 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d40f0628-a929-4953-bed1-4778aba9d14e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:22.753350 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d40f0628-a929-4953-bed1-4778aba9d14e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:22.753780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d40f0628-a929-4953-bed1-4778aba9d14e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:22.943338 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-d40f0628-a929-4953-bed1-4778aba9d14e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:22.953211 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d40f0628-a929-4953-bed1-4778aba9d14e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1501 microversion: 2.1 time: 0.232002 May 09 23:04:22.954255 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 116/231] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:22 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1501 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:22.970603 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-39c55f87-ba07-437f-ba61-64b754ef5e4d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7f83ee9-7add-4eee-8687-81ad50f6b1d9"}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:22.972610 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-39c55f87-ba07-437f-ba61-64b754ef5e4d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:22.979435 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-39c55f87-ba07-437f-ba61-64b754ef5e4d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:22.982135 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-39c55f87-ba07-437f-ba61-64b754ef5e4d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:22.983198 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-39c55f87-ba07-437f-ba61-64b754ef5e4d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:22.983955 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-39c55f87-ba07-437f-ba61-64b754ef5e4d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:23.014676 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-39c55f87-ba07-437f-ba61-64b754ef5e4d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] HTTP exception thrown: Cannot 'attach_volume' instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 while it is in vm_state rescued May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-39c55f87-ba07-437f-ba61-64b754ef5e4d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Request method failure captured: May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: POST /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7/os-volume_attachments HTTP/1.1 May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 74 May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ2FFz9vnmF8wAewdVUSwImcpsQ_FwsT9_7-H0Toz28qyLF5raYcR0RdwhQ7DcuMUUb6fbU3N9fxJ3lqVbGJA-eSv-tQlbFOPaZxX5sJAbjs8F6A88WSsbHqIz7xSQ8sIzcyDrkQNCaIK1p8i0U8DUR4GQ-9BgcmVdUyMXRTEAlwBLw May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 0cb055ff9f0d4af6962070c7a2f19bf3 May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:04:23.017362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:04:23.018825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:04:23.018825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:04:23.018825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 0cb055ff9f0d4af6962070c7a2f19bf3 May 09 23:04:23.018825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:04:23.018825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-ServerRescueNegativeTestJSON-345311633-project May 09 23:04:23.018825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:04:23.018825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:04:23.018825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: e41b4feaa9be44e89210b70c19ef10ab May 09 23:04:23.018825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-ServerRescueNegativeTestJSON-345311633-project May 09 23:04:23.018825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: May 09 23:04:23.018825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {"volumeAttachment": {"volumeId": "a7f83ee9-7add-4eee-8687-81ad50f6b1d9"}} May 09 23:04:23.018825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Cannot 'attach_volume' instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 while it is in vm_state rescued May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'server_id': 'ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7', 'body': {'volumeAttachment': {'volumeId': 'a7f83ee9-7add-4eee-8687-81ad50f6b1d9'}}} May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:04:23.019582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 while it is in vm_state rescued May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:04:23.020691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:04:23.021932 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:04:23.021932 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:04:23.021932 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 while it is in vm_state rescued May 09 23:04:23.021932 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:04:23.025095 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-39c55f87-ba07-437f-ba61-64b754ef5e4d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Returning 409 to user: Cannot 'attach_volume' instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 while it is in vm_state rescued {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:04:23.026786 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-39c55f87-ba07-437f-ba61-64b754ef5e4d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "POST /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.060452 May 09 23:04:23.027417 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 116/232] 10.222.0.23 () {60 vars in 1322 bytes} [Mon May 9 23:04:22 2022] POST /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 09 23:04:23.036624 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c1d86ddb-7331-45cc-adf1-7fb9fbbe73aa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:23.037215 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c1d86ddb-7331-45cc-adf1-7fb9fbbe73aa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:23.043391 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c1d86ddb-7331-45cc-adf1-7fb9fbbe73aa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:23.044132 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c1d86ddb-7331-45cc-adf1-7fb9fbbe73aa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:23.045170 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c1d86ddb-7331-45cc-adf1-7fb9fbbe73aa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:23.045692 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c1d86ddb-7331-45cc-adf1-7fb9fbbe73aa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:23.140929 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c1d86ddb-7331-45cc-adf1-7fb9fbbe73aa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "POST /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7/action" status: 202 len: 0 microversion: 2.1 time: 0.108340 May 09 23:04:23.141635 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 117/233] 10.222.0.23 () {60 vars in 1277 bytes} [Mon May 9 23:04:23 2022] POST /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:04:23.152041 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b51cf501-7c16-489f-94d6-8a4e962543c1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:23.152662 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b51cf501-7c16-489f-94d6-8a4e962543c1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:23.160521 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b51cf501-7c16-489f-94d6-8a4e962543c1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:23.161363 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b51cf501-7c16-489f-94d6-8a4e962543c1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:23.162366 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b51cf501-7c16-489f-94d6-8a4e962543c1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:23.162960 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b51cf501-7c16-489f-94d6-8a4e962543c1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:23.376689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b51cf501-7c16-489f-94d6-8a4e962543c1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:23.398409 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b51cf501-7c16-489f-94d6-8a4e962543c1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1509 microversion: 2.1 time: 0.242319 May 09 23:04:23.399085 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 117/234] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:23 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1509 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:24.418855 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-249187f3-9c39-4090-a1bc-6e1004e50011 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:24.420292 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-249187f3-9c39-4090-a1bc-6e1004e50011 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:24.428947 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-249187f3-9c39-4090-a1bc-6e1004e50011 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:24.430714 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-249187f3-9c39-4090-a1bc-6e1004e50011 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:24.431763 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-249187f3-9c39-4090-a1bc-6e1004e50011 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:24.433439 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-249187f3-9c39-4090-a1bc-6e1004e50011 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:24.754402 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-249187f3-9c39-4090-a1bc-6e1004e50011 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:24.767189 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-249187f3-9c39-4090-a1bc-6e1004e50011 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1509 microversion: 2.1 time: 0.353598 May 09 23:04:24.768321 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 118/235] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:24 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1509 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:25.785440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-cb046699-a51f-4e0a-a1cb-c56f61065884 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:25.786033 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-cb046699-a51f-4e0a-a1cb-c56f61065884 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:25.806856 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cb046699-a51f-4e0a-a1cb-c56f61065884 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:25.807408 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cb046699-a51f-4e0a-a1cb-c56f61065884 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:25.808603 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cb046699-a51f-4e0a-a1cb-c56f61065884 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:25.809227 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cb046699-a51f-4e0a-a1cb-c56f61065884 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:26.003869 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-cb046699-a51f-4e0a-a1cb-c56f61065884 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:26.012942 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-cb046699-a51f-4e0a-a1cb-c56f61065884 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1509 microversion: 2.1 time: 0.231901 May 09 23:04:26.015162 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 118/236] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:25 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:27.032687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a1aece9e-2b85-4717-ab52-222d1f10e6fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:27.033889 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a1aece9e-2b85-4717-ab52-222d1f10e6fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:27.047544 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a1aece9e-2b85-4717-ab52-222d1f10e6fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:27.048723 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a1aece9e-2b85-4717-ab52-222d1f10e6fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:27.050385 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a1aece9e-2b85-4717-ab52-222d1f10e6fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:27.050385 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a1aece9e-2b85-4717-ab52-222d1f10e6fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:27.192481 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a1aece9e-2b85-4717-ab52-222d1f10e6fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:27.204409 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a1aece9e-2b85-4717-ab52-222d1f10e6fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1509 microversion: 2.1 time: 0.176108 May 09 23:04:27.205545 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 119/237] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:27 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:28.221545 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-12399dd4-3185-4c4d-b5a3-bd9127e3da60 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:28.222781 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-12399dd4-3185-4c4d-b5a3-bd9127e3da60 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:28.229474 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-12399dd4-3185-4c4d-b5a3-bd9127e3da60 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:28.229912 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-12399dd4-3185-4c4d-b5a3-bd9127e3da60 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:28.230924 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-12399dd4-3185-4c4d-b5a3-bd9127e3da60 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:28.231507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-12399dd4-3185-4c4d-b5a3-bd9127e3da60 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:28.377016 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-12399dd4-3185-4c4d-b5a3-bd9127e3da60 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:28.396975 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-12399dd4-3185-4c4d-b5a3-bd9127e3da60 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1509 microversion: 2.1 time: 0.179975 May 09 23:04:28.397566 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 119/238] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:28 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:29.414867 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c3facb56-2153-49b9-b3b2-3daeee7a0d51 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:29.415488 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c3facb56-2153-49b9-b3b2-3daeee7a0d51 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:29.422044 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c3facb56-2153-49b9-b3b2-3daeee7a0d51 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:29.422846 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c3facb56-2153-49b9-b3b2-3daeee7a0d51 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:29.424617 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c3facb56-2153-49b9-b3b2-3daeee7a0d51 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:29.425306 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c3facb56-2153-49b9-b3b2-3daeee7a0d51 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:29.578474 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c3facb56-2153-49b9-b3b2-3daeee7a0d51 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:29.586609 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c3facb56-2153-49b9-b3b2-3daeee7a0d51 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1515 microversion: 2.1 time: 0.175653 May 09 23:04:29.587427 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 120/239] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:29 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:29.858343 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-3f1842b1-4f35-4234-b5f5-cfa9e5ca8fd6 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Action: 'create', calling method: .version_select at 0x7fc2986d7af0>, body: {"keypair": {"name": "tempest-keypair-994992470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5AusUe8iXBICUr3eUiyeP3387nuzlg3m5txt0aeilz54o58yyGlW29YJXh37oJMqj1xlbLWVfs5d3Nov5rTeGeJAa6udL01GbWJbvVj3uSeFy+OwVuejToFfGCsSsUFw=="}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:29.885280 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-3f1842b1-4f35-4234-b5f5-cfa9e5ca8fd6 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for project b776734a879d4c0785b1d3728b79b766. Resources: {'key_pairs'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:04:29.898853 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-3f1842b1-4f35-4234-b5f5-cfa9e5ca8fd6 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for user 84a45506c19c4cda8173c164a097f925 and project b776734a879d4c0785b1d3728b79b766. Resources: {'key_pairs'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:04:29.987620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-3f1842b1-4f35-4234-b5f5-cfa9e5ca8fd6 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.134413 May 09 23:04:29.988723 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 120/240] 10.222.0.23 () {60 vars in 1158 bytes} [Mon May 9 23:04:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:04:31.041375 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-670a3a20-5761-452b-b099-567f25b6e00e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Action: 'create', calling method: .version_select at 0x7fc28bd140d0>, body: {"keypair": {"name": "tempest-keypair-2068948099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoo9YRkAsB7bCfSm6DB9ewU7h9pO35KhI+HMGEHbOTUu4l35Bl9wFQ5IvGjwnk96oIAI/xM5G0/cIXYB83d8lEXSTj/HAc3Q15mZjhGewceFWgMWo+O7vojBm4ancnP2g=="}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:31.065389 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-670a3a20-5761-452b-b099-567f25b6e00e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Getting quotas for project 0cb055ff9f0d4af6962070c7a2f19bf3. Resources: {'key_pairs'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:04:31.069847 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-670a3a20-5761-452b-b099-567f25b6e00e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Getting quotas for user e41b4feaa9be44e89210b70c19ef10ab and project 0cb055ff9f0d4af6962070c7a2f19bf3. Resources: {'key_pairs'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:04:31.101013 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-670a3a20-5761-452b-b099-567f25b6e00e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063409 May 09 23:04:31.102059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 121/241] 10.222.0.23 () {60 vars in 1158 bytes} [Mon May 9 23:04:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:04:31.700728 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1720481558", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8d1714e-6adf-478e-9341-0aabd043adfd"}], "security_groups": [{"name": "tempest-securitygroup--475710989"}], "key_name": "tempest-keypair-994992470", "user_data": "}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:31.905079 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.network.neutron [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] validate_networks() for [('a8d1714e-6adf-478e-9341-0aabd043adfd', None, None, None, None, None)] {{(pid=117143) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:04:32.768292 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Flavor limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:04:32.770030 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Image limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:04:32.770796 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Flavor pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:04:32.771579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Image pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:04:32.772533 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:04:32.794647 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:32.796161 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:32.797316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:32.797964 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:32.864482 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for project b776734a879d4c0785b1d3728b79b766. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:04:32.880895 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for user 84a45506c19c4cda8173c164a097f925 and project b776734a879d4c0785b1d3728b79b766. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:04:32.902295 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Going to run 1 instances... {{(pid=117143) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:04:32.905985 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:04:32.996129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-54b6e345-724b-4a36-ad71-b7053f753a1d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.300692 May 09 23:04:32.998657 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 121/242] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:04:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:04:33.021047 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0fd8a34e-a611-47c8-aae6-9f29ac51ea2d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:33.034047 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-0fd8a34e-a611-47c8-aae6-9f29ac51ea2d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:33.139927 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-0fd8a34e-a611-47c8-aae6-9f29ac51ea2d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:33.156874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0fd8a34e-a611-47c8-aae6-9f29ac51ea2d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1241 microversion: 2.1 time: 0.143791 May 09 23:04:33.157679 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 122/243] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:33 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1241 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:33.653700 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-36219357", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22e6fa81-87ea-460b-b290-1c8d865027a7"}], "security_groups": [{"name": "tempest-securitygroup--1790413761"}], "key_name": "tempest-keypair-2068948099", "user_data": "}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:33.903061 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-614b9cce-0436-43f3-aa9b-36895e6442e1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Action: 'create', calling method: .version_select at 0x7fc28bd140d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2109316223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVXRryGJOzj5bj632PcrAXBDTQbrosTP6DVtDnHD7PNxbU5SFgtYrmL4MGbBrpz9LNa66zJNm/VjhP2MEvorG0w3sQiVX/YTlp6ZFA3psuS74431s5yD7L5uit/kJaOyg=="}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:33.917924 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-614b9cce-0436-43f3-aa9b-36895e6442e1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Getting quotas for project 93df4f41ba52453dabfd21f82cb9238b. Resources: {'key_pairs'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:04:33.921979 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-614b9cce-0436-43f3-aa9b-36895e6442e1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Getting quotas for user 19fbe84526dd48a6be14c1aebf5713c0 and project 93df4f41ba52453dabfd21f82cb9238b. Resources: {'key_pairs'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:04:33.943867 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-614b9cce-0436-43f3-aa9b-36895e6442e1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.044766 May 09 23:04:33.944642 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 123/244] 10.222.0.23 () {60 vars in 1158 bytes} [Mon May 9 23:04:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:04:33.979203 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.network.neutron [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] validate_networks() for [('22e6fa81-87ea-460b-b290-1c8d865027a7', None, None, None, None, None)] {{(pid=117143) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:04:33.993763 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1355876684", "imageRef": "47fbc2c9-8029-40d6-af5b-39ad16e15d97", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2109316223", "networks": [{"uuid": "38b8c3e2-c1d3-4ff0-a24c-7030c224e8d6"}]}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:34.043104 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.network.neutron [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] validate_networks() for [('38b8c3e2-c1d3-4ff0-a24c-7030c224e8d6', None, None, None, None, None)] {{(pid=117142) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:04:34.385923 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Flavor limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:04:34.386603 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Image limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:04:34.387081 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Flavor pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:04:34.387654 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Image pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:04:34.388102 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:04:34.398039 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:34.398770 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:34.400745 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:34.401372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:34.423183 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Getting quotas for project 0cb055ff9f0d4af6962070c7a2f19bf3. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:04:34.434404 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Getting quotas for user e41b4feaa9be44e89210b70c19ef10ab and project 0cb055ff9f0d4af6962070c7a2f19bf3. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:04:34.446994 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Going to run 1 instances... {{(pid=117143) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:04:34.449195 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:04:34.500278 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-4e6418af-34b7-4ded-b907-6c1cc42ffe5d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.851037 May 09 23:04:34.505640 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 122/245] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:04:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 09 23:04:34.506190 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6e0805df-fc5a-4c6a-b0c5-43e4a2054398 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:34.507026 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6e0805df-fc5a-4c6a-b0c5-43e4a2054398 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:34.512841 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6e0805df-fc5a-4c6a-b0c5-43e4a2054398 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:34.513369 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6e0805df-fc5a-4c6a-b0c5-43e4a2054398 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:34.514169 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6e0805df-fc5a-4c6a-b0c5-43e4a2054398 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:34.514613 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6e0805df-fc5a-4c6a-b0c5-43e4a2054398 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:34.598869 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6e0805df-fc5a-4c6a-b0c5-43e4a2054398 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:34.606043 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Flavor limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:04:34.606584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Image limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:04:34.607943 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Flavor pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:04:34.608425 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Image pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:04:34.608918 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:04:34.614823 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6e0805df-fc5a-4c6a-b0c5-43e4a2054398 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1299 microversion: 2.1 time: 0.112270 May 09 23:04:34.618329 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:34.618878 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:34.619906 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:34.620418 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:34.626658 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 123/246] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:34 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:34.631618 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-234eb3de-7cab-461d-a1c0-8857f6307117 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:34.632233 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-234eb3de-7cab-461d-a1c0-8857f6307117 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:34.639724 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Getting quotas for project 93df4f41ba52453dabfd21f82cb9238b. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:04:34.644318 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Getting quotas for user 19fbe84526dd48a6be14c1aebf5713c0 and project 93df4f41ba52453dabfd21f82cb9238b. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:04:34.657080 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Going to run 1 instances... {{(pid=117142) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:04:34.659212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47fbc2c9-8029-40d6-af5b-39ad16e15d97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:04:34.702247 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-234eb3de-7cab-461d-a1c0-8857f6307117 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:34.709949 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-234eb3de-7cab-461d-a1c0-8857f6307117 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1244 microversion: 2.1 time: 0.082228 May 09 23:04:34.710746 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 124/247] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:34 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:34.724387 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-52c513b0-e1b6-4364-9fa6-ecd33fe0f53f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734471 May 09 23:04:34.725034 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 124/248] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:04:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 09 23:04:34.738678 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-64e4ef9d-d8eb-4bb8-a745-2e6503a9f08a tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:34.739517 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-64e4ef9d-d8eb-4bb8-a745-2e6503a9f08a tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:34.803399 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-64e4ef9d-d8eb-4bb8-a745-2e6503a9f08a tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:34.811347 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-64e4ef9d-d8eb-4bb8-a745-2e6503a9f08a tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1259 microversion: 2.1 time: 0.079975 May 09 23:04:34.812390 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 125/249] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:34 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:35.632947 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-919ab91f-b1c3-4998-af87-17cef0936fa5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:35.634077 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-919ab91f-b1c3-4998-af87-17cef0936fa5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:35.646249 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-919ab91f-b1c3-4998-af87-17cef0936fa5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:35.646790 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-919ab91f-b1c3-4998-af87-17cef0936fa5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:35.647691 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-919ab91f-b1c3-4998-af87-17cef0936fa5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:35.648338 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-919ab91f-b1c3-4998-af87-17cef0936fa5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:35.727651 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-21fd00c0-90a8-4bfc-a921-849c81a4d5dc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:35.728972 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-21fd00c0-90a8-4bfc-a921-849c81a4d5dc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:35.736486 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-21fd00c0-90a8-4bfc-a921-849c81a4d5dc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:35.737035 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-21fd00c0-90a8-4bfc-a921-849c81a4d5dc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:35.737883 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-21fd00c0-90a8-4bfc-a921-849c81a4d5dc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:35.738405 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-21fd00c0-90a8-4bfc-a921-849c81a4d5dc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:35.815166 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-21fd00c0-90a8-4bfc-a921-849c81a4d5dc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:35.823984 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-21fd00c0-90a8-4bfc-a921-849c81a4d5dc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1314 microversion: 2.1 time: 0.100071 May 09 23:04:35.824727 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 126/250] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:35 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1314 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:35.832480 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-3df33ee9-8f99-4a67-a536-c8be9cb7d750 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:35.833084 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-3df33ee9-8f99-4a67-a536-c8be9cb7d750 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:35.839367 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3df33ee9-8f99-4a67-a536-c8be9cb7d750 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:35.839814 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3df33ee9-8f99-4a67-a536-c8be9cb7d750 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:35.840580 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3df33ee9-8f99-4a67-a536-c8be9cb7d750 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:35.841011 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3df33ee9-8f99-4a67-a536-c8be9cb7d750 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:35.911517 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3df33ee9-8f99-4a67-a536-c8be9cb7d750 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:35.917423 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-919ab91f-b1c3-4998-af87-17cef0936fa5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:35.920002 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-3df33ee9-8f99-4a67-a536-c8be9cb7d750 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1311 microversion: 2.1 time: 0.090653 May 09 23:04:35.920584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 127/251] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:35 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:35.926767 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-919ab91f-b1c3-4998-af87-17cef0936fa5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.297616 May 09 23:04:35.927512 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 125/252] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:35 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:36.554759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-e36279dc-0844-43d4-8c88-2fcd72c42cf9 req-3158e2a1-d676-4320-8d8e-d2b333e8cfeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a46c08db-d64b-4794-85f2-3ade7544e841", "tag": "dd84391b-cd8f-4c04-9bb7-f12890f8e469"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:36.569425 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-e36279dc-0844-43d4-8c88-2fcd72c42cf9 req-3158e2a1-d676-4320-8d8e-d2b333e8cfeb service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:36.570534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-e36279dc-0844-43d4-8c88-2fcd72c42cf9 req-3158e2a1-d676-4320-8d8e-d2b333e8cfeb service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:36.600485 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-e36279dc-0844-43d4-8c88-2fcd72c42cf9 req-3158e2a1-d676-4320-8d8e-d2b333e8cfeb service nova] Creating event network-changed:dd84391b-cd8f-4c04-9bb7-f12890f8e469 for instance a46c08db-d64b-4794-85f2-3ade7544e841 on hv-cinder-84067 May 09 23:04:36.605948 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-e36279dc-0844-43d4-8c88-2fcd72c42cf9 req-3158e2a1-d676-4320-8d8e-d2b333e8cfeb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055197 May 09 23:04:36.607867 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 128/253] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:04:36.846812 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e3e93c7e-b3a3-44cb-839f-5e9dfe291ec6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:36.847463 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e3e93c7e-b3a3-44cb-839f-5e9dfe291ec6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:36.864959 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e3e93c7e-b3a3-44cb-839f-5e9dfe291ec6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:36.869258 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e3e93c7e-b3a3-44cb-839f-5e9dfe291ec6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:36.878729 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e3e93c7e-b3a3-44cb-839f-5e9dfe291ec6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:36.879935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e3e93c7e-b3a3-44cb-839f-5e9dfe291ec6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:36.955401 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-4762017d-687f-4d8e-936c-650c9c025acf tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:36.956213 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-4762017d-687f-4d8e-936c-650c9c025acf tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:37.011841 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4762017d-687f-4d8e-936c-650c9c025acf tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:37.015049 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4762017d-687f-4d8e-936c-650c9c025acf tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:37.021839 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4762017d-687f-4d8e-936c-650c9c025acf tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:37.026149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4762017d-687f-4d8e-936c-650c9c025acf tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:37.229987 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4762017d-687f-4d8e-936c-650c9c025acf tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:37.246862 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-4762017d-687f-4d8e-936c-650c9c025acf tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1317 microversion: 2.1 time: 0.311508 May 09 23:04:37.250505 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 129/254] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:36 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:37.264426 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0cc0b123-1a6c-46bf-a7ba-ddba6ead6e35 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:37.265196 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-0cc0b123-1a6c-46bf-a7ba-ddba6ead6e35 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:37.276805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0cc0b123-1a6c-46bf-a7ba-ddba6ead6e35 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:37.277762 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0cc0b123-1a6c-46bf-a7ba-ddba6ead6e35 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:37.290162 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0cc0b123-1a6c-46bf-a7ba-ddba6ead6e35 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:37.298267 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0cc0b123-1a6c-46bf-a7ba-ddba6ead6e35 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:37.328752 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e3e93c7e-b3a3-44cb-839f-5e9dfe291ec6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:37.336151 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e3e93c7e-b3a3-44cb-839f-5e9dfe291ec6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.498679 May 09 23:04:37.336716 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 126/255] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:36 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:37.530013 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-0cc0b123-1a6c-46bf-a7ba-ddba6ead6e35 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:37.539199 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-0cc0b123-1a6c-46bf-a7ba-ddba6ead6e35 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.286839 May 09 23:04:37.540139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 130/256] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:37 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:38.265563 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-30702711-0863-45ab-901b-1af1a02a1037 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:38.267046 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-30702711-0863-45ab-901b-1af1a02a1037 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:38.274571 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-30702711-0863-45ab-901b-1af1a02a1037 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:38.275169 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-30702711-0863-45ab-901b-1af1a02a1037 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:38.276063 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-30702711-0863-45ab-901b-1af1a02a1037 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:38.276575 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-30702711-0863-45ab-901b-1af1a02a1037 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:38.352844 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-74cbd7ae-ae5b-45b4-bcc8-82521d4d032a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:38.353506 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-74cbd7ae-ae5b-45b4-bcc8-82521d4d032a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:38.360097 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-74cbd7ae-ae5b-45b4-bcc8-82521d4d032a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:38.360545 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-74cbd7ae-ae5b-45b4-bcc8-82521d4d032a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:38.361318 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-74cbd7ae-ae5b-45b4-bcc8-82521d4d032a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:38.361792 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-74cbd7ae-ae5b-45b4-bcc8-82521d4d032a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:38.448663 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-30702711-0863-45ab-901b-1af1a02a1037 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:38.457935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-30702711-0863-45ab-901b-1af1a02a1037 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.197018 May 09 23:04:38.468768 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 127/257] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:38 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:38.558350 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-74cbd7ae-ae5b-45b4-bcc8-82521d4d032a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:38.563979 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0f35be95-f238-402a-a58f-89663cbea313 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:38.564791 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-0f35be95-f238-402a-a58f-89663cbea313 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:38.567242 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-74cbd7ae-ae5b-45b4-bcc8-82521d4d032a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.218157 May 09 23:04:38.577658 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 131/258] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:38 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:38.577881 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0f35be95-f238-402a-a58f-89663cbea313 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:38.577881 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0f35be95-f238-402a-a58f-89663cbea313 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:38.577881 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0f35be95-f238-402a-a58f-89663cbea313 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:38.577881 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0f35be95-f238-402a-a58f-89663cbea313 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:38.736582 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-0f35be95-f238-402a-a58f-89663cbea313 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:38.746184 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0f35be95-f238-402a-a58f-89663cbea313 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.193605 May 09 23:04:38.747038 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 128/259] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:38 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:39.476274 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-099d0edf-3703-4885-b100-6948b31d0521 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:39.477058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-099d0edf-3703-4885-b100-6948b31d0521 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:39.484679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-099d0edf-3703-4885-b100-6948b31d0521 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:39.485134 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-099d0edf-3703-4885-b100-6948b31d0521 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:39.485923 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-099d0edf-3703-4885-b100-6948b31d0521 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:39.486384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-099d0edf-3703-4885-b100-6948b31d0521 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:39.584780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-45c5f8c0-6f4d-4956-8607-4d8c001cebf9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:39.586744 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-45c5f8c0-6f4d-4956-8607-4d8c001cebf9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:39.597101 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-45c5f8c0-6f4d-4956-8607-4d8c001cebf9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:39.597625 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-45c5f8c0-6f4d-4956-8607-4d8c001cebf9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:39.599130 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-45c5f8c0-6f4d-4956-8607-4d8c001cebf9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:39.599591 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-45c5f8c0-6f4d-4956-8607-4d8c001cebf9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:39.632965 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-099d0edf-3703-4885-b100-6948b31d0521 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:39.648174 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-099d0edf-3703-4885-b100-6948b31d0521 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.175838 May 09 23:04:39.648908 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 132/260] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:39 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:39.764488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5205220b-1882-40e3-9267-1ceac32b61a1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:39.765102 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-5205220b-1882-40e3-9267-1ceac32b61a1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:39.770981 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5205220b-1882-40e3-9267-1ceac32b61a1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:39.771435 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5205220b-1882-40e3-9267-1ceac32b61a1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:39.772213 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5205220b-1882-40e3-9267-1ceac32b61a1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:39.772739 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5205220b-1882-40e3-9267-1ceac32b61a1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:39.773107 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-45c5f8c0-6f4d-4956-8607-4d8c001cebf9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:39.781433 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-45c5f8c0-6f4d-4956-8607-4d8c001cebf9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.200567 May 09 23:04:39.784191 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 129/261] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:39 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:39.918610 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-5205220b-1882-40e3-9267-1ceac32b61a1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:39.927450 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-5205220b-1882-40e3-9267-1ceac32b61a1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.166953 May 09 23:04:39.928313 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 133/262] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:39 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:40.664765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-b5d8a837-0773-4f5f-8ae9-2e465128ce21 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:40.665374 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-b5d8a837-0773-4f5f-8ae9-2e465128ce21 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:40.672870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b5d8a837-0773-4f5f-8ae9-2e465128ce21 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:40.673352 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b5d8a837-0773-4f5f-8ae9-2e465128ce21 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:40.674208 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b5d8a837-0773-4f5f-8ae9-2e465128ce21 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:40.674668 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b5d8a837-0773-4f5f-8ae9-2e465128ce21 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:40.799712 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-49bd6b61-905f-4044-a6fc-ee028f201b5b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:40.800672 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-49bd6b61-905f-4044-a6fc-ee028f201b5b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:40.807318 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-49bd6b61-905f-4044-a6fc-ee028f201b5b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:40.807930 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-49bd6b61-905f-4044-a6fc-ee028f201b5b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:40.808951 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-49bd6b61-905f-4044-a6fc-ee028f201b5b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:40.809493 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-49bd6b61-905f-4044-a6fc-ee028f201b5b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:40.818243 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-b5d8a837-0773-4f5f-8ae9-2e465128ce21 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:40.827622 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-b5d8a837-0773-4f5f-8ae9-2e465128ce21 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.166641 May 09 23:04:40.829944 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 130/263] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:40 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:40.944352 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a6775db3-eb07-4b6a-b645-f792406ce925 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:40.944960 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a6775db3-eb07-4b6a-b645-f792406ce925 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:40.950760 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a6775db3-eb07-4b6a-b645-f792406ce925 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:40.951210 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a6775db3-eb07-4b6a-b645-f792406ce925 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:40.951979 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a6775db3-eb07-4b6a-b645-f792406ce925 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:40.952415 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a6775db3-eb07-4b6a-b645-f792406ce925 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:40.955932 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-49bd6b61-905f-4044-a6fc-ee028f201b5b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:40.963544 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-49bd6b61-905f-4044-a6fc-ee028f201b5b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.168591 May 09 23:04:40.964137 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 134/264] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:40 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:41.091077 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a6775db3-eb07-4b6a-b645-f792406ce925 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:41.098880 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a6775db3-eb07-4b6a-b645-f792406ce925 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.158372 May 09 23:04:41.099443 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 131/265] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:40 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:41.845410 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-da6a86d7-fe97-4fc9-a20e-f463215c6ea1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:41.845978 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-da6a86d7-fe97-4fc9-a20e-f463215c6ea1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:41.858477 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-da6a86d7-fe97-4fc9-a20e-f463215c6ea1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:41.858942 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-da6a86d7-fe97-4fc9-a20e-f463215c6ea1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:41.859738 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-da6a86d7-fe97-4fc9-a20e-f463215c6ea1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:41.860178 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-da6a86d7-fe97-4fc9-a20e-f463215c6ea1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:41.980798 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d9b4150a-45af-4133-a869-be13aa3e5eb0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:41.981426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-d9b4150a-45af-4133-a869-be13aa3e5eb0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:41.988157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d9b4150a-45af-4133-a869-be13aa3e5eb0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:41.988610 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d9b4150a-45af-4133-a869-be13aa3e5eb0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:41.989384 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d9b4150a-45af-4133-a869-be13aa3e5eb0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:41.989820 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d9b4150a-45af-4133-a869-be13aa3e5eb0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:42.002720 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-da6a86d7-fe97-4fc9-a20e-f463215c6ea1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:42.011490 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-da6a86d7-fe97-4fc9-a20e-f463215c6ea1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.170207 May 09 23:04:42.012725 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 135/266] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:41 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:42.117222 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c79191b2-f4a2-4229-8b3c-4cc230f70ac5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:42.118265 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c79191b2-f4a2-4229-8b3c-4cc230f70ac5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:42.126748 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c79191b2-f4a2-4229-8b3c-4cc230f70ac5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:42.127284 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c79191b2-f4a2-4229-8b3c-4cc230f70ac5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:42.128277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c79191b2-f4a2-4229-8b3c-4cc230f70ac5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:42.128755 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c79191b2-f4a2-4229-8b3c-4cc230f70ac5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:42.138149 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-d9b4150a-45af-4133-a869-be13aa3e5eb0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:42.147494 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d9b4150a-45af-4133-a869-be13aa3e5eb0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.170476 May 09 23:04:42.148086 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 132/267] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:41 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:42.278109 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c79191b2-f4a2-4229-8b3c-4cc230f70ac5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:42.286683 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c79191b2-f4a2-4229-8b3c-4cc230f70ac5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.174015 May 09 23:04:42.287265 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 136/268] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:42 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:43.029557 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-942b55ef-7935-464b-8e01-24fd1de8344b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:43.030418 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-942b55ef-7935-464b-8e01-24fd1de8344b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:43.045707 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-942b55ef-7935-464b-8e01-24fd1de8344b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:43.046182 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-942b55ef-7935-464b-8e01-24fd1de8344b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:43.046979 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-942b55ef-7935-464b-8e01-24fd1de8344b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:43.047420 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-942b55ef-7935-464b-8e01-24fd1de8344b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:43.164611 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0f9a03ec-7794-4175-a5c4-31cbbbd8c46d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:43.165536 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-0f9a03ec-7794-4175-a5c4-31cbbbd8c46d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:43.171833 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0f9a03ec-7794-4175-a5c4-31cbbbd8c46d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:43.172425 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0f9a03ec-7794-4175-a5c4-31cbbbd8c46d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:43.173293 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0f9a03ec-7794-4175-a5c4-31cbbbd8c46d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:43.173939 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0f9a03ec-7794-4175-a5c4-31cbbbd8c46d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:43.190281 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-942b55ef-7935-464b-8e01-24fd1de8344b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:43.198829 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-942b55ef-7935-464b-8e01-24fd1de8344b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.173071 May 09 23:04:43.212383 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 133/269] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:43 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:43.304249 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-deb1d96a-d7f1-4bca-9054-98eba1f89bc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:43.304861 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-deb1d96a-d7f1-4bca-9054-98eba1f89bc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:43.311262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-deb1d96a-d7f1-4bca-9054-98eba1f89bc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:43.311708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-deb1d96a-d7f1-4bca-9054-98eba1f89bc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:43.312482 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-deb1d96a-d7f1-4bca-9054-98eba1f89bc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:43.312919 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-deb1d96a-d7f1-4bca-9054-98eba1f89bc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:43.327565 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-0f9a03ec-7794-4175-a5c4-31cbbbd8c46d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:43.334885 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-0f9a03ec-7794-4175-a5c4-31cbbbd8c46d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.174623 May 09 23:04:43.335478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 137/270] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:43 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:43.446863 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-deb1d96a-d7f1-4bca-9054-98eba1f89bc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:43.454483 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-deb1d96a-d7f1-4bca-9054-98eba1f89bc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.154067 May 09 23:04:43.455074 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 134/271] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:43 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:44.216862 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-990473b7-fb70-4334-9606-dc3a407d4fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:44.218463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-990473b7-fb70-4334-9606-dc3a407d4fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:44.224945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-990473b7-fb70-4334-9606-dc3a407d4fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:44.225396 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-990473b7-fb70-4334-9606-dc3a407d4fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:44.226202 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-990473b7-fb70-4334-9606-dc3a407d4fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:44.226643 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-990473b7-fb70-4334-9606-dc3a407d4fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:44.353028 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f98a829c-a467-4853-98c6-09730bb7deb4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:44.353646 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f98a829c-a467-4853-98c6-09730bb7deb4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:44.360290 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f98a829c-a467-4853-98c6-09730bb7deb4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:44.360741 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f98a829c-a467-4853-98c6-09730bb7deb4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:44.361524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f98a829c-a467-4853-98c6-09730bb7deb4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:44.361958 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f98a829c-a467-4853-98c6-09730bb7deb4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:44.368187 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-990473b7-fb70-4334-9606-dc3a407d4fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:44.379790 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-990473b7-fb70-4334-9606-dc3a407d4fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.166920 May 09 23:04:44.388821 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 138/272] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:44 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:44.471805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a2f87091-25b7-4c9f-b9f4-99e027ca77cf tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:44.472416 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a2f87091-25b7-4c9f-b9f4-99e027ca77cf tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:44.478491 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a2f87091-25b7-4c9f-b9f4-99e027ca77cf tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:44.478938 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a2f87091-25b7-4c9f-b9f4-99e027ca77cf tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:44.479712 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a2f87091-25b7-4c9f-b9f4-99e027ca77cf tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:44.480141 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a2f87091-25b7-4c9f-b9f4-99e027ca77cf tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:44.521623 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f98a829c-a467-4853-98c6-09730bb7deb4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:44.529926 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f98a829c-a467-4853-98c6-09730bb7deb4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.180715 May 09 23:04:44.540525 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 135/273] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:44 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:44.624252 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a2f87091-25b7-4c9f-b9f4-99e027ca77cf tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:44.631915 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a2f87091-25b7-4c9f-b9f4-99e027ca77cf tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.163863 May 09 23:04:44.632618 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 139/274] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:44 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:45.397021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-402972bf-be72-4079-a770-2e531223b123 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:45.398361 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-402972bf-be72-4079-a770-2e531223b123 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:45.405914 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-402972bf-be72-4079-a770-2e531223b123 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:45.406510 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-402972bf-be72-4079-a770-2e531223b123 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:45.407376 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-402972bf-be72-4079-a770-2e531223b123 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:45.407892 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-402972bf-be72-4079-a770-2e531223b123 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:45.540684 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-402972bf-be72-4079-a770-2e531223b123 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:45.548896 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1e7657aa-f725-4ab2-a7f1-bca6a22a841f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:45.549554 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1e7657aa-f725-4ab2-a7f1-bca6a22a841f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:45.550780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-402972bf-be72-4079-a770-2e531223b123 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.157475 May 09 23:04:45.551588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 136/275] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:45 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:45.556349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1e7657aa-f725-4ab2-a7f1-bca6a22a841f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:45.556824 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1e7657aa-f725-4ab2-a7f1-bca6a22a841f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:45.557599 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1e7657aa-f725-4ab2-a7f1-bca6a22a841f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:45.558026 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1e7657aa-f725-4ab2-a7f1-bca6a22a841f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:45.650520 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f5690fea-89e0-40b4-aba1-1ff07579a81c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:45.651133 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f5690fea-89e0-40b4-aba1-1ff07579a81c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:45.657809 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f5690fea-89e0-40b4-aba1-1ff07579a81c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:45.658395 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f5690fea-89e0-40b4-aba1-1ff07579a81c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:45.659166 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f5690fea-89e0-40b4-aba1-1ff07579a81c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:45.659597 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f5690fea-89e0-40b4-aba1-1ff07579a81c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:45.699182 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1e7657aa-f725-4ab2-a7f1-bca6a22a841f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:45.707755 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1e7657aa-f725-4ab2-a7f1-bca6a22a841f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.163176 May 09 23:04:45.708534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 140/276] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:45 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:45.804511 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f5690fea-89e0-40b4-aba1-1ff07579a81c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:45.818542 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f5690fea-89e0-40b4-aba1-1ff07579a81c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.171761 May 09 23:04:45.819763 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 137/277] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:45 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:46.572027 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1d750c94-a2ba-430a-b22d-db4f10540a4d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:46.572639 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1d750c94-a2ba-430a-b22d-db4f10540a4d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:46.579490 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1d750c94-a2ba-430a-b22d-db4f10540a4d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:46.579951 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1d750c94-a2ba-430a-b22d-db4f10540a4d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:46.580804 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1d750c94-a2ba-430a-b22d-db4f10540a4d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:46.581265 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1d750c94-a2ba-430a-b22d-db4f10540a4d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:46.708817 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1d750c94-a2ba-430a-b22d-db4f10540a4d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:46.715995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1d750c94-a2ba-430a-b22d-db4f10540a4d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.147867 May 09 23:04:46.716571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 141/278] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:46 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:46.724336 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-8e73b87d-d526-424d-87d0-3c6dd9797871 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:46.725047 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-8e73b87d-d526-424d-87d0-3c6dd9797871 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:46.731249 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8e73b87d-d526-424d-87d0-3c6dd9797871 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:46.731697 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8e73b87d-d526-424d-87d0-3c6dd9797871 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:46.732773 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8e73b87d-d526-424d-87d0-3c6dd9797871 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:46.733708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8e73b87d-d526-424d-87d0-3c6dd9797871 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:46.836244 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-4dfe432f-8bfc-4524-bb29-327498acf706 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:46.836748 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-4dfe432f-8bfc-4524-bb29-327498acf706 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:46.843012 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4dfe432f-8bfc-4524-bb29-327498acf706 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:46.843467 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4dfe432f-8bfc-4524-bb29-327498acf706 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:46.844245 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4dfe432f-8bfc-4524-bb29-327498acf706 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:46.844686 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4dfe432f-8bfc-4524-bb29-327498acf706 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:46.862724 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-8e73b87d-d526-424d-87d0-3c6dd9797871 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:46.870215 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-8e73b87d-d526-424d-87d0-3c6dd9797871 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.149532 May 09 23:04:46.870792 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 138/279] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:46 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:46.971171 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4dfe432f-8bfc-4524-bb29-327498acf706 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:46.978313 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-4dfe432f-8bfc-4524-bb29-327498acf706 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.146033 May 09 23:04:46.978884 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 142/280] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:46 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:47.733583 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5b0f5741-8458-4be5-b6db-3054eb8c3275 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:47.734814 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5b0f5741-8458-4be5-b6db-3054eb8c3275 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:47.741881 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5b0f5741-8458-4be5-b6db-3054eb8c3275 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:47.742541 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5b0f5741-8458-4be5-b6db-3054eb8c3275 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:47.743734 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5b0f5741-8458-4be5-b6db-3054eb8c3275 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:47.744375 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5b0f5741-8458-4be5-b6db-3054eb8c3275 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:47.866300 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-a47e7d7b-616a-49f5-9c42-777e9a85344b req-dbfd8944-a80c-413c-bd55-eae5e287da59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bccbae96-189c-4f1a-8a18-a94e8684d9b6", "tag": "f4111c9d-b7d8-4877-85f0-8a4596bfc164"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:47.878050 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-a47e7d7b-616a-49f5-9c42-777e9a85344b req-dbfd8944-a80c-413c-bd55-eae5e287da59 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:47.878525 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-a47e7d7b-616a-49f5-9c42-777e9a85344b req-dbfd8944-a80c-413c-bd55-eae5e287da59 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:47.902634 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-a47e7d7b-616a-49f5-9c42-777e9a85344b req-dbfd8944-a80c-413c-bd55-eae5e287da59 service nova] Creating event network-changed:f4111c9d-b7d8-4877-85f0-8a4596bfc164 for instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 on hv-cinder-84067 May 09 23:04:47.909891 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-a47e7d7b-616a-49f5-9c42-777e9a85344b req-dbfd8944-a80c-413c-bd55-eae5e287da59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046652 May 09 23:04:47.911555 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 143/281] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:04:47.922133 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-22ef2378-2b26-4072-bb2c-96cbecd648b8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:47.923047 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-22ef2378-2b26-4072-bb2c-96cbecd648b8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:47.930644 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-22ef2378-2b26-4072-bb2c-96cbecd648b8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:47.931476 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-22ef2378-2b26-4072-bb2c-96cbecd648b8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:47.932503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-22ef2378-2b26-4072-bb2c-96cbecd648b8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:47.933152 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-22ef2378-2b26-4072-bb2c-96cbecd648b8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:48.025848 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5b0f5741-8458-4be5-b6db-3054eb8c3275 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:48.034478 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5b0f5741-8458-4be5-b6db-3054eb8c3275 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.305466 May 09 23:04:48.035611 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 139/282] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:47 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:48.041030 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-4ed980d6-b5af-464a-847a-a03c984faf3e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:48.041842 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-4ed980d6-b5af-464a-847a-a03c984faf3e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:48.063664 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4ed980d6-b5af-464a-847a-a03c984faf3e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:48.068457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4ed980d6-b5af-464a-847a-a03c984faf3e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:48.069701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4ed980d6-b5af-464a-847a-a03c984faf3e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:48.070345 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4ed980d6-b5af-464a-847a-a03c984faf3e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:48.112855 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-22ef2378-2b26-4072-bb2c-96cbecd648b8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:48.120956 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-22ef2378-2b26-4072-bb2c-96cbecd648b8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.207939 May 09 23:04:48.121841 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 144/283] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:47 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:48.249939 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-6f11730f-b9f3-4665-9fe5-1c91cb46f2c8 req-a416a406-bae5-4d41-8713-9456892eb083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93373b9f-f998-4983-9b08-7b874cf7c76e", "tag": "49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:48.258883 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-6f11730f-b9f3-4665-9fe5-1c91cb46f2c8 req-a416a406-bae5-4d41-8713-9456892eb083 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:48.259604 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-6f11730f-b9f3-4665-9fe5-1c91cb46f2c8 req-a416a406-bae5-4d41-8713-9456892eb083 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:48.273092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-6f11730f-b9f3-4665-9fe5-1c91cb46f2c8 req-a416a406-bae5-4d41-8713-9456892eb083 service nova] Creating event network-changed:49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787 for instance 93373b9f-f998-4983-9b08-7b874cf7c76e on hv-cinder-84067 May 09 23:04:48.278105 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-6f11730f-b9f3-4665-9fe5-1c91cb46f2c8 req-a416a406-bae5-4d41-8713-9456892eb083 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032382 May 09 23:04:48.279201 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 145/284] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:04:48.286346 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-4ed980d6-b5af-464a-847a-a03c984faf3e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:48.297672 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-4ed980d6-b5af-464a-847a-a03c984faf3e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.260606 May 09 23:04:48.298283 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 140/285] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:48 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:49.052495 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c65a38cf-243c-4b8d-b57f-3bc735883892 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:49.053493 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c65a38cf-243c-4b8d-b57f-3bc735883892 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:49.059951 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c65a38cf-243c-4b8d-b57f-3bc735883892 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:49.060487 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c65a38cf-243c-4b8d-b57f-3bc735883892 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:49.061863 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c65a38cf-243c-4b8d-b57f-3bc735883892 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:49.062398 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c65a38cf-243c-4b8d-b57f-3bc735883892 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:49.144282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-691520c0-0ae5-45f3-9e80-590058e330c5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:49.146427 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-691520c0-0ae5-45f3-9e80-590058e330c5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:49.156051 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-691520c0-0ae5-45f3-9e80-590058e330c5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:49.156976 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-691520c0-0ae5-45f3-9e80-590058e330c5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:49.164011 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-691520c0-0ae5-45f3-9e80-590058e330c5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:49.164510 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-691520c0-0ae5-45f3-9e80-590058e330c5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:49.272759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c65a38cf-243c-4b8d-b57f-3bc735883892 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:49.280949 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c65a38cf-243c-4b8d-b57f-3bc735883892 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.232666 May 09 23:04:49.282317 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 146/286] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:49 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:49.315747 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a834ac26-544c-4aba-a920-43c0fc7fc063 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:49.316450 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a834ac26-544c-4aba-a920-43c0fc7fc063 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:49.322308 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a834ac26-544c-4aba-a920-43c0fc7fc063 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:49.322845 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a834ac26-544c-4aba-a920-43c0fc7fc063 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:49.323679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a834ac26-544c-4aba-a920-43c0fc7fc063 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:49.324185 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a834ac26-544c-4aba-a920-43c0fc7fc063 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:49.460918 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a834ac26-544c-4aba-a920-43c0fc7fc063 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:49.469172 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a834ac26-544c-4aba-a920-43c0fc7fc063 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.156960 May 09 23:04:49.470145 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 147/287] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:49 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:49.473298 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-691520c0-0ae5-45f3-9e80-590058e330c5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:49.481565 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-691520c0-0ae5-45f3-9e80-590058e330c5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.345462 May 09 23:04:49.482616 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 141/288] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:49 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:50.298170 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0890375a-1254-4eda-a1f2-6a4d742dbd83 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:50.298784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-0890375a-1254-4eda-a1f2-6a4d742dbd83 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:50.305822 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0890375a-1254-4eda-a1f2-6a4d742dbd83 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:50.306347 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0890375a-1254-4eda-a1f2-6a4d742dbd83 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:50.307154 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0890375a-1254-4eda-a1f2-6a4d742dbd83 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:50.307614 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0890375a-1254-4eda-a1f2-6a4d742dbd83 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:50.438488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-0890375a-1254-4eda-a1f2-6a4d742dbd83 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:50.445774 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-0890375a-1254-4eda-a1f2-6a4d742dbd83 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.151456 May 09 23:04:50.446543 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 148/289] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:50 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:50.486524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-731d9c03-150f-4bd0-a601-e914d9cc9514 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:50.487231 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-731d9c03-150f-4bd0-a601-e914d9cc9514 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:50.493307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-731d9c03-150f-4bd0-a601-e914d9cc9514 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:50.493760 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-731d9c03-150f-4bd0-a601-e914d9cc9514 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:50.494562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-731d9c03-150f-4bd0-a601-e914d9cc9514 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:50.494995 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-731d9c03-150f-4bd0-a601-e914d9cc9514 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:50.499848 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-19b3a33c-4ec2-470a-9079-e8228ca2fc90 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:50.500614 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-19b3a33c-4ec2-470a-9079-e8228ca2fc90 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:50.506637 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-19b3a33c-4ec2-470a-9079-e8228ca2fc90 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:50.507195 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-19b3a33c-4ec2-470a-9079-e8228ca2fc90 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:50.508253 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-19b3a33c-4ec2-470a-9079-e8228ca2fc90 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:50.508760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-19b3a33c-4ec2-470a-9079-e8228ca2fc90 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:50.650099 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-731d9c03-150f-4bd0-a601-e914d9cc9514 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:50.651534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-19b3a33c-4ec2-470a-9079-e8228ca2fc90 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:50.658374 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-731d9c03-150f-4bd0-a601-e914d9cc9514 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.175569 May 09 23:04:50.658959 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 142/290] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:50 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:50.659648 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-19b3a33c-4ec2-470a-9079-e8228ca2fc90 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.164197 May 09 23:04:50.669587 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 149/291] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:50 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:51.463202 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-72cf5f66-db4b-4389-878f-bfeaab1edcf3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:51.463742 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-72cf5f66-db4b-4389-878f-bfeaab1edcf3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:51.470034 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-72cf5f66-db4b-4389-878f-bfeaab1edcf3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:51.470506 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-72cf5f66-db4b-4389-878f-bfeaab1edcf3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:51.471265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-72cf5f66-db4b-4389-878f-bfeaab1edcf3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:51.471699 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-72cf5f66-db4b-4389-878f-bfeaab1edcf3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:51.598480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-72cf5f66-db4b-4389-878f-bfeaab1edcf3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:51.605737 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-72cf5f66-db4b-4389-878f-bfeaab1edcf3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.146439 May 09 23:04:51.606344 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 143/292] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:51 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:51.674937 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e56ed58b-e9f0-4f0b-874e-97010a2872d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:51.675561 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e56ed58b-e9f0-4f0b-874e-97010a2872d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:51.676562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-685ddaac-797a-41e6-bb0d-8ef8550fb627 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:51.677249 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-685ddaac-797a-41e6-bb0d-8ef8550fb627 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:51.681968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e56ed58b-e9f0-4f0b-874e-97010a2872d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:51.682459 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e56ed58b-e9f0-4f0b-874e-97010a2872d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:51.683190 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-685ddaac-797a-41e6-bb0d-8ef8550fb627 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:51.683318 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e56ed58b-e9f0-4f0b-874e-97010a2872d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:51.683654 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e56ed58b-e9f0-4f0b-874e-97010a2872d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:51.684499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-685ddaac-797a-41e6-bb0d-8ef8550fb627 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:51.685369 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-685ddaac-797a-41e6-bb0d-8ef8550fb627 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:51.686154 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-685ddaac-797a-41e6-bb0d-8ef8550fb627 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:51.835362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e56ed58b-e9f0-4f0b-874e-97010a2872d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:51.839474 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-685ddaac-797a-41e6-bb0d-8ef8550fb627 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:51.845650 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e56ed58b-e9f0-4f0b-874e-97010a2872d1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.174513 May 09 23:04:51.848800 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-685ddaac-797a-41e6-bb0d-8ef8550fb627 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.176044 May 09 23:04:51.849843 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 144/293] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:51 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:51.855320 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 150/294] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:51 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:52.622707 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9662bcaa-a074-4e14-b36b-7a9c931d171a tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:52.623914 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9662bcaa-a074-4e14-b36b-7a9c931d171a tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:52.630298 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9662bcaa-a074-4e14-b36b-7a9c931d171a tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:52.630757 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9662bcaa-a074-4e14-b36b-7a9c931d171a tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:52.631538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9662bcaa-a074-4e14-b36b-7a9c931d171a tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:52.631977 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9662bcaa-a074-4e14-b36b-7a9c931d171a tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:52.757930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-9662bcaa-a074-4e14-b36b-7a9c931d171a tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:52.765088 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9662bcaa-a074-4e14-b36b-7a9c931d171a tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.146215 May 09 23:04:52.765673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 145/295] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:52 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:52.862621 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6fc6eff8-4682-4500-ae4c-cfced95c5b00 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:52.863249 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6fc6eff8-4682-4500-ae4c-cfced95c5b00 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:52.865128 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0d0d9c63-f2a5-4b84-8ab0-05e61e7b7c8d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:52.865766 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-0d0d9c63-f2a5-4b84-8ab0-05e61e7b7c8d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:52.869555 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6fc6eff8-4682-4500-ae4c-cfced95c5b00 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:52.870003 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6fc6eff8-4682-4500-ae4c-cfced95c5b00 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:52.870790 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6fc6eff8-4682-4500-ae4c-cfced95c5b00 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:52.871217 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6fc6eff8-4682-4500-ae4c-cfced95c5b00 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:52.871473 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0d0d9c63-f2a5-4b84-8ab0-05e61e7b7c8d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:52.871928 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0d0d9c63-f2a5-4b84-8ab0-05e61e7b7c8d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:52.872694 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0d0d9c63-f2a5-4b84-8ab0-05e61e7b7c8d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:52.873188 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0d0d9c63-f2a5-4b84-8ab0-05e61e7b7c8d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:53.008359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-0d0d9c63-f2a5-4b84-8ab0-05e61e7b7c8d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:53.012625 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6fc6eff8-4682-4500-ae4c-cfced95c5b00 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:53.016189 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0d0d9c63-f2a5-4b84-8ab0-05e61e7b7c8d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.154700 May 09 23:04:53.016850 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 146/296] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:52 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:53.020733 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6fc6eff8-4682-4500-ae4c-cfced95c5b00 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.162542 May 09 23:04:53.021292 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 151/297] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:52 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:53.511712 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-9fb043cc-efad-4656-9edd-4d50847b1dce req-32be49eb-2ad5-4652-9cb2-fd66ebe210d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46c08db-d64b-4794-85f2-3ade7544e841", "name": "network-vif-plugged", "status": "completed", "tag": "dd84391b-cd8f-4c04-9bb7-f12890f8e469"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:53.520406 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-9fb043cc-efad-4656-9edd-4d50847b1dce req-32be49eb-2ad5-4652-9cb2-fd66ebe210d3 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:53.520863 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-9fb043cc-efad-4656-9edd-4d50847b1dce req-32be49eb-2ad5-4652-9cb2-fd66ebe210d3 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:53.533386 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-9fb043cc-efad-4656-9edd-4d50847b1dce req-32be49eb-2ad5-4652-9cb2-fd66ebe210d3 service nova] Creating event network-vif-plugged:dd84391b-cd8f-4c04-9bb7-f12890f8e469 for instance a46c08db-d64b-4794-85f2-3ade7544e841 on hv-cinder-84067 May 09 23:04:53.538495 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-9fb043cc-efad-4656-9edd-4d50847b1dce req-32be49eb-2ad5-4652-9cb2-fd66ebe210d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030508 May 09 23:04:53.539160 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 147/298] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:04:53.665223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-85348cd5-800f-4a17-87fe-1134b8993c98 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:53.665716 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-85348cd5-800f-4a17-87fe-1134b8993c98 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:53.671558 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-85348cd5-800f-4a17-87fe-1134b8993c98 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:53.672004 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-85348cd5-800f-4a17-87fe-1134b8993c98 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:53.672780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-85348cd5-800f-4a17-87fe-1134b8993c98 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:53.673212 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-85348cd5-800f-4a17-87fe-1134b8993c98 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:53.696156 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-85348cd5-800f-4a17-87fe-1134b8993c98 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/ips" status: 200 len: 152 microversion: 2.20 time: 0.034760 May 09 23:04:53.696738 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 152/299] 10.222.0.23 () {60 vars in 1288 bytes} [Mon May 9 23:04:53 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 23:04:53.781717 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c45ecb5f-1b85-410d-968f-4fd0d473a891 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:53.782506 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c45ecb5f-1b85-410d-968f-4fd0d473a891 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:53.788519 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c45ecb5f-1b85-410d-968f-4fd0d473a891 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:53.789563 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c45ecb5f-1b85-410d-968f-4fd0d473a891 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:53.790380 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c45ecb5f-1b85-410d-968f-4fd0d473a891 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:53.790829 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c45ecb5f-1b85-410d-968f-4fd0d473a891 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:53.932671 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c45ecb5f-1b85-410d-968f-4fd0d473a891 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:53.944606 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c45ecb5f-1b85-410d-968f-4fd0d473a891 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.167516 May 09 23:04:53.945256 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 148/300] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:53 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:54.038708 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7429e7ab-8216-4305-b674-c2fc8395efd7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:54.039215 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-caf98576-8060-4421-a00c-dc414ded2987 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:54.039330 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7429e7ab-8216-4305-b674-c2fc8395efd7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:54.039426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-caf98576-8060-4421-a00c-dc414ded2987 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:54.045685 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-caf98576-8060-4421-a00c-dc414ded2987 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:54.046058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7429e7ab-8216-4305-b674-c2fc8395efd7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:54.046243 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-caf98576-8060-4421-a00c-dc414ded2987 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:54.046544 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7429e7ab-8216-4305-b674-c2fc8395efd7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:54.046923 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-caf98576-8060-4421-a00c-dc414ded2987 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:54.047316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7429e7ab-8216-4305-b674-c2fc8395efd7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:54.047434 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-caf98576-8060-4421-a00c-dc414ded2987 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:54.047755 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7429e7ab-8216-4305-b674-c2fc8395efd7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:54.190543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-caf98576-8060-4421-a00c-dc414ded2987 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:54.192445 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7429e7ab-8216-4305-b674-c2fc8395efd7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:54.198913 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-caf98576-8060-4421-a00c-dc414ded2987 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.163979 May 09 23:04:54.199496 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 149/301] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:54 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:54.199795 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7429e7ab-8216-4305-b674-c2fc8395efd7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.164922 May 09 23:04:54.200822 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 153/302] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:54 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:54.961498 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-52cb7380-bb25-4e13-9a1e-fe59131742ce tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:54.962016 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-52cb7380-bb25-4e13-9a1e-fe59131742ce tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:54.968807 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-52cb7380-bb25-4e13-9a1e-fe59131742ce tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:54.969255 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-52cb7380-bb25-4e13-9a1e-fe59131742ce tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:54.970013 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-52cb7380-bb25-4e13-9a1e-fe59131742ce tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:54.970470 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-52cb7380-bb25-4e13-9a1e-fe59131742ce tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:55.097443 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-52cb7380-bb25-4e13-9a1e-fe59131742ce tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:55.104624 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-52cb7380-bb25-4e13-9a1e-fe59131742ce tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.147007 May 09 23:04:55.105195 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 150/303] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:54 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:55.216035 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e17a19b9-3d31-4c2b-90cd-3499852e1fa0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:55.216535 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a72ced36-d434-45bb-aef9-b6b42aa6dd52 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:55.216635 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e17a19b9-3d31-4c2b-90cd-3499852e1fa0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:55.217427 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a72ced36-d434-45bb-aef9-b6b42aa6dd52 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:55.223230 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a72ced36-d434-45bb-aef9-b6b42aa6dd52 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:55.223402 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e17a19b9-3d31-4c2b-90cd-3499852e1fa0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:55.223677 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a72ced36-d434-45bb-aef9-b6b42aa6dd52 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:55.223859 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e17a19b9-3d31-4c2b-90cd-3499852e1fa0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:55.224434 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a72ced36-d434-45bb-aef9-b6b42aa6dd52 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:55.224634 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e17a19b9-3d31-4c2b-90cd-3499852e1fa0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:55.224869 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a72ced36-d434-45bb-aef9-b6b42aa6dd52 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:55.225073 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e17a19b9-3d31-4c2b-90cd-3499852e1fa0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:55.386657 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a72ced36-d434-45bb-aef9-b6b42aa6dd52 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:55.399856 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e17a19b9-3d31-4c2b-90cd-3499852e1fa0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:55.408268 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a72ced36-d434-45bb-aef9-b6b42aa6dd52 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1366 microversion: 2.1 time: 0.194490 May 09 23:04:55.410495 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e17a19b9-3d31-4c2b-90cd-3499852e1fa0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.198273 May 09 23:04:55.410667 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 151/304] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:55 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:55.419371 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 154/305] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:55 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:55.594947 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-50d08def-c492-42f2-9929-ad0fbd9a627f req-57d6ec58-d7bd-4502-973d-a2b54866ad8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bccbae96-189c-4f1a-8a18-a94e8684d9b6", "name": "network-vif-plugged", "status": "completed", "tag": "f4111c9d-b7d8-4877-85f0-8a4596bfc164"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:55.603895 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-50d08def-c492-42f2-9929-ad0fbd9a627f req-57d6ec58-d7bd-4502-973d-a2b54866ad8e service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:55.604757 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-50d08def-c492-42f2-9929-ad0fbd9a627f req-57d6ec58-d7bd-4502-973d-a2b54866ad8e service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:55.620410 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-50d08def-c492-42f2-9929-ad0fbd9a627f req-57d6ec58-d7bd-4502-973d-a2b54866ad8e service nova] Creating event network-vif-plugged:f4111c9d-b7d8-4877-85f0-8a4596bfc164 for instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 on hv-cinder-84067 May 09 23:04:55.625534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-50d08def-c492-42f2-9929-ad0fbd9a627f req-57d6ec58-d7bd-4502-973d-a2b54866ad8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035078 May 09 23:04:55.626816 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 152/306] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:04:55.643616 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d19bb2ff-5869-457d-800c-4eab778960c5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:55.644372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d19bb2ff-5869-457d-800c-4eab778960c5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:55.652869 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d19bb2ff-5869-457d-800c-4eab778960c5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:55.653557 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d19bb2ff-5869-457d-800c-4eab778960c5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:55.655624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d19bb2ff-5869-457d-800c-4eab778960c5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:55.656241 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d19bb2ff-5869-457d-800c-4eab778960c5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:55.697888 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.objects.instance [None req-d19bb2ff-5869-457d-800c-4eab778960c5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lazy-loading 'flavor' on Instance uuid 2e5734d5-da65-4ee8-8684-e236f56da50a {{(pid=117143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:04:56.000097 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d19bb2ff-5869-457d-800c-4eab778960c5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "POST /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/action" status: 202 len: 0 microversion: 2.20 time: 0.361422 May 09 23:04:56.000764 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 155/307] 10.222.0.23 () {62 vars in 1318 bytes} [Mon May 9 23:04:55 2022] POST /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 23:04:56.010055 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-990bda70-1e36-4308-8c9b-be4e184d6ffe tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:56.010785 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-990bda70-1e36-4308-8c9b-be4e184d6ffe tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:56.017655 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-990bda70-1e36-4308-8c9b-be4e184d6ffe tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:56.018100 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-990bda70-1e36-4308-8c9b-be4e184d6ffe tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:56.018896 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-990bda70-1e36-4308-8c9b-be4e184d6ffe tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:56.019334 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-990bda70-1e36-4308-8c9b-be4e184d6ffe tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:56.122435 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ee2a680d-0e54-477f-9e79-b7ee54a8838b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:56.123188 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ee2a680d-0e54-477f-9e79-b7ee54a8838b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:56.141188 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ee2a680d-0e54-477f-9e79-b7ee54a8838b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:56.141856 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ee2a680d-0e54-477f-9e79-b7ee54a8838b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:56.142661 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ee2a680d-0e54-477f-9e79-b7ee54a8838b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:56.143098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ee2a680d-0e54-477f-9e79-b7ee54a8838b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:56.172575 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-990bda70-1e36-4308-8c9b-be4e184d6ffe tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:56.181307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-990bda70-1e36-4308-8c9b-be4e184d6ffe tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:56.183179 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-990bda70-1e36-4308-8c9b-be4e184d6ffe tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:56.184869 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-990bda70-1e36-4308-8c9b-be4e184d6ffe tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.179428 May 09 23:04:56.196985 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 153/308] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:04:56 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:04:56.278401 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ee2a680d-0e54-477f-9e79-b7ee54a8838b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:56.285675 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ee2a680d-0e54-477f-9e79-b7ee54a8838b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.167753 May 09 23:04:56.286276 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 156/309] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:56 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:56.427212 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-84eeba2e-82a4-441b-b9f8-3ccce9f5f857 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:56.427900 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-84eeba2e-82a4-441b-b9f8-3ccce9f5f857 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:56.429907 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5cc88983-7244-4e64-82ed-5bfad17b9a6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:56.430301 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5cc88983-7244-4e64-82ed-5bfad17b9a6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:56.434097 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84eeba2e-82a4-441b-b9f8-3ccce9f5f857 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:56.434580 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84eeba2e-82a4-441b-b9f8-3ccce9f5f857 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:56.435349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84eeba2e-82a4-441b-b9f8-3ccce9f5f857 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:56.436708 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84eeba2e-82a4-441b-b9f8-3ccce9f5f857 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:56.438755 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5cc88983-7244-4e64-82ed-5bfad17b9a6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:56.439207 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5cc88983-7244-4e64-82ed-5bfad17b9a6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:56.439980 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5cc88983-7244-4e64-82ed-5bfad17b9a6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:56.441841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5cc88983-7244-4e64-82ed-5bfad17b9a6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:56.574901 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5cc88983-7244-4e64-82ed-5bfad17b9a6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:56.582605 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-84eeba2e-82a4-441b-b9f8-3ccce9f5f857 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:56.583737 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5cc88983-7244-4e64-82ed-5bfad17b9a6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1556 microversion: 2.1 time: 0.160158 May 09 23:04:56.584569 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 154/310] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:56 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:56.590887 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-84eeba2e-82a4-441b-b9f8-3ccce9f5f857 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1370 microversion: 2.1 time: 0.167781 May 09 23:04:56.591709 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 157/311] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:56 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:56.601941 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1a4ba5ed-fa6c-4ca6-a8b3-798a350aea4e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:56.602479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1a4ba5ed-fa6c-4ca6-a8b3-798a350aea4e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:56.608692 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1a4ba5ed-fa6c-4ca6-a8b3-798a350aea4e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:56.609154 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1a4ba5ed-fa6c-4ca6-a8b3-798a350aea4e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:56.609973 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1a4ba5ed-fa6c-4ca6-a8b3-798a350aea4e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:56.610402 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1a4ba5ed-fa6c-4ca6-a8b3-798a350aea4e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:56.697806 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1a4ba5ed-fa6c-4ca6-a8b3-798a350aea4e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101260 May 09 23:04:56.698555 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 155/312] 10.222.0.23 () {58 vars in 1274 bytes} [Mon May 9 23:04:56 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:04:57.204801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-eb7fdbcf-dd2f-410f-9636-098e4c1fc6f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:57.206430 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-eb7fdbcf-dd2f-410f-9636-098e4c1fc6f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:57.214594 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-eb7fdbcf-dd2f-410f-9636-098e4c1fc6f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:57.215244 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-eb7fdbcf-dd2f-410f-9636-098e4c1fc6f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:57.217317 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-eb7fdbcf-dd2f-410f-9636-098e4c1fc6f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:57.218001 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-eb7fdbcf-dd2f-410f-9636-098e4c1fc6f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:57.306181 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-807c1cca-2c7c-4b33-be46-6f1bce903851 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:57.307071 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-807c1cca-2c7c-4b33-be46-6f1bce903851 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:57.315491 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-807c1cca-2c7c-4b33-be46-6f1bce903851 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:57.316101 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-807c1cca-2c7c-4b33-be46-6f1bce903851 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:57.317044 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-807c1cca-2c7c-4b33-be46-6f1bce903851 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:57.317591 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-807c1cca-2c7c-4b33-be46-6f1bce903851 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:57.465428 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-807c1cca-2c7c-4b33-be46-6f1bce903851 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:57.473757 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-807c1cca-2c7c-4b33-be46-6f1bce903851 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.174468 May 09 23:04:57.481099 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 156/313] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:57 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:57.609178 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-4b0a1eb8-855c-4322-a729-0b4719946cc0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:57.609890 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-4b0a1eb8-855c-4322-a729-0b4719946cc0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:57.617939 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4b0a1eb8-855c-4322-a729-0b4719946cc0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:57.618713 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4b0a1eb8-855c-4322-a729-0b4719946cc0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:57.619684 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4b0a1eb8-855c-4322-a729-0b4719946cc0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:57.620297 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4b0a1eb8-855c-4322-a729-0b4719946cc0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:57.740621 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-eb7fdbcf-dd2f-410f-9636-098e4c1fc6f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:57.749807 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-eb7fdbcf-dd2f-410f-9636-098e4c1fc6f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:57.751357 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-eb7fdbcf-dd2f-410f-9636-098e4c1fc6f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:57.752742 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-eb7fdbcf-dd2f-410f-9636-098e4c1fc6f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.552491 May 09 23:04:57.753306 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 158/314] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:04:57 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:04:57.757959 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-677fdd5b-e9cc-42ee-b41b-7b22ab824ca9 req-99f3e137-c043-4fda-a7ab-ec78aa34001a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93373b9f-f998-4983-9b08-7b874cf7c76e", "name": "network-vif-plugged", "status": "completed", "tag": "49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:57.766043 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-677fdd5b-e9cc-42ee-b41b-7b22ab824ca9 req-99f3e137-c043-4fda-a7ab-ec78aa34001a service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:57.766515 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-677fdd5b-e9cc-42ee-b41b-7b22ab824ca9 req-99f3e137-c043-4fda-a7ab-ec78aa34001a service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:57.777176 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-677fdd5b-e9cc-42ee-b41b-7b22ab824ca9 req-99f3e137-c043-4fda-a7ab-ec78aa34001a service nova] Creating event network-vif-plugged:49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787 for instance 93373b9f-f998-4983-9b08-7b874cf7c76e on hv-cinder-84067 May 09 23:04:57.782253 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-677fdd5b-e9cc-42ee-b41b-7b22ab824ca9 req-99f3e137-c043-4fda-a7ab-ec78aa34001a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027682 May 09 23:04:57.783534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 159/315] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:04:57.792449 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-4b0a1eb8-855c-4322-a729-0b4719946cc0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:57.801015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-4b0a1eb8-855c-4322-a729-0b4719946cc0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1565 microversion: 2.1 time: 0.196773 May 09 23:04:57.801892 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 157/316] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:57 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1565 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:04:57.819176 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-383f2141-4265-4f05-a9b7-c2caff30d245 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:57.820008 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-383f2141-4265-4f05-a9b7-c2caff30d245 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:57.826364 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-383f2141-4265-4f05-a9b7-c2caff30d245 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:57.827098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-383f2141-4265-4f05-a9b7-c2caff30d245 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:57.828078 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-383f2141-4265-4f05-a9b7-c2caff30d245 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:57.828529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-383f2141-4265-4f05-a9b7-c2caff30d245 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:57.988936 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-383f2141-4265-4f05-a9b7-c2caff30d245 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174051 May 09 23:04:57.989542 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 160/317] 10.222.0.23 () {58 vars in 1274 bytes} [Mon May 9 23:04:57 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:04:58.353135 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-b3364f11-e9c2-495b-ae2b-66d966f054c9 req-1127d746-599d-4b6d-b7d5-1f54703e8a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a46c08db-d64b-4794-85f2-3ade7544e841", "tag": "dd84391b-cd8f-4c04-9bb7-f12890f8e469"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:58.368479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-b3364f11-e9c2-495b-ae2b-66d966f054c9 req-1127d746-599d-4b6d-b7d5-1f54703e8a4b service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:58.369301 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-b3364f11-e9c2-495b-ae2b-66d966f054c9 req-1127d746-599d-4b6d-b7d5-1f54703e8a4b service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:58.387106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-b3364f11-e9c2-495b-ae2b-66d966f054c9 req-1127d746-599d-4b6d-b7d5-1f54703e8a4b service nova] Creating event network-changed:dd84391b-cd8f-4c04-9bb7-f12890f8e469 for instance a46c08db-d64b-4794-85f2-3ade7544e841 on hv-cinder-84067 May 09 23:04:58.394939 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-b3364f11-e9c2-495b-ae2b-66d966f054c9 req-1127d746-599d-4b6d-b7d5-1f54703e8a4b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044499 May 09 23:04:58.396152 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 158/318] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:04:58.491522 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-33572e30-5414-49b5-8c22-ea7871e11ca3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:58.492419 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-33572e30-5414-49b5-8c22-ea7871e11ca3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:58.505879 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-33572e30-5414-49b5-8c22-ea7871e11ca3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:58.506731 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-33572e30-5414-49b5-8c22-ea7871e11ca3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:58.507669 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-33572e30-5414-49b5-8c22-ea7871e11ca3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:58.508577 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-33572e30-5414-49b5-8c22-ea7871e11ca3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:58.675711 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-33572e30-5414-49b5-8c22-ea7871e11ca3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:58.683060 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-33572e30-5414-49b5-8c22-ea7871e11ca3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.195744 May 09 23:04:58.683638 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 161/319] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:58 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:04:58.772888 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-7ab0c238-ca7f-4921-befe-20eaaef7d540 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:58.773975 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-7ab0c238-ca7f-4921-befe-20eaaef7d540 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:58.786427 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7ab0c238-ca7f-4921-befe-20eaaef7d540 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:58.786892 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7ab0c238-ca7f-4921-befe-20eaaef7d540 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:58.792452 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7ab0c238-ca7f-4921-befe-20eaaef7d540 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:58.793082 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7ab0c238-ca7f-4921-befe-20eaaef7d540 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:59.326058 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-7ab0c238-ca7f-4921-befe-20eaaef7d540 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:59.335226 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-7ab0c238-ca7f-4921-befe-20eaaef7d540 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:59.336749 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-7ab0c238-ca7f-4921-befe-20eaaef7d540 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:04:59.338108 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-7ab0c238-ca7f-4921-befe-20eaaef7d540 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.570537 May 09 23:04:59.338918 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 159/320] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:04:58 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:04:59.596251 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-7f272ddb-d8e6-493b-8248-709b2189c414 req-f6d79f1e-47e9-4f54-89d1-a2e743514033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bccbae96-189c-4f1a-8a18-a94e8684d9b6", "tag": "f4111c9d-b7d8-4877-85f0-8a4596bfc164"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:59.605149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-7f272ddb-d8e6-493b-8248-709b2189c414 req-f6d79f1e-47e9-4f54-89d1-a2e743514033 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:59.605592 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-7f272ddb-d8e6-493b-8248-709b2189c414 req-f6d79f1e-47e9-4f54-89d1-a2e743514033 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:59.618636 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-7f272ddb-d8e6-493b-8248-709b2189c414 req-f6d79f1e-47e9-4f54-89d1-a2e743514033 service nova] Creating event network-changed:f4111c9d-b7d8-4877-85f0-8a4596bfc164 for instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 on hv-cinder-84067 May 09 23:04:59.632931 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-7f272ddb-d8e6-493b-8248-709b2189c414 req-f6d79f1e-47e9-4f54-89d1-a2e743514033 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040505 May 09 23:04:59.634144 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 162/321] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:04:59.700222 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-28004fe1-0b80-4d94-95ae-895ed7240d28 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:04:59.700877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-28004fe1-0b80-4d94-95ae-895ed7240d28 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:04:59.708990 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-28004fe1-0b80-4d94-95ae-895ed7240d28 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:59.709436 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-28004fe1-0b80-4d94-95ae-895ed7240d28 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:59.710589 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-28004fe1-0b80-4d94-95ae-895ed7240d28 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:04:59.711183 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-28004fe1-0b80-4d94-95ae-895ed7240d28 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:04:59.926199 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1162058385", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "networks": [{"uuid": "378d612b-31ab-4d07-8c08-26e101d40f29"}]}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:04:59.986177 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.network.neutron [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] validate_networks() for [('378d612b-31ab-4d07-8c08-26e101d40f29', None, None, None, None, None)] {{(pid=117143) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:05:00.076786 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-28004fe1-0b80-4d94-95ae-895ed7240d28 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:00.087053 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-28004fe1-0b80-4d94-95ae-895ed7240d28 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1359 microversion: 2.1 time: 0.390248 May 09 23:05:00.098232 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 160/322] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:04:59 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1359 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:00.358229 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a231e796-e4cf-4eab-8fdc-a180e67c6a89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:00.358711 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a231e796-e4cf-4eab-8fdc-a180e67c6a89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:00.368022 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a231e796-e4cf-4eab-8fdc-a180e67c6a89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:00.368706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a231e796-e4cf-4eab-8fdc-a180e67c6a89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:00.370491 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a231e796-e4cf-4eab-8fdc-a180e67c6a89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:00.371101 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a231e796-e4cf-4eab-8fdc-a180e67c6a89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:00.373720 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Flavor limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:05:00.374298 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Image limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:05:00.375065 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Flavor pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:05:00.375754 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Image pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:05:00.376634 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:05:00.387557 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:00.388297 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:00.389304 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:00.389981 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:00.410495 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Getting quotas for project 9a54785a57d74beb87b5a31f928583e7. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:05:00.415161 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Getting quotas for user 7d3e164b111b4c3784b220ef483bb5b9 and project 9a54785a57d74beb87b5a31f928583e7. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:05:00.428002 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Going to run 1 instances... {{(pid=117143) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:05:00.430584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:05:00.477586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-875feb30-1986-4142-9d24-b93a8755e44d tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556317 May 09 23:05:00.484417 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 163/323] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:04:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:05:00.489382 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-698e1952-dbdb-4449-972f-21521a78d3ac tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:00.490175 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-698e1952-dbdb-4449-972f-21521a78d3ac tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:00.556181 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-698e1952-dbdb-4449-972f-21521a78d3ac tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:00.563149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-698e1952-dbdb-4449-972f-21521a78d3ac tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1219 microversion: 2.1 time: 0.077179 May 09 23:05:00.572890 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 164/324] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:00 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:00.608181 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a231e796-e4cf-4eab-8fdc-a180e67c6a89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:00.619549 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a231e796-e4cf-4eab-8fdc-a180e67c6a89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:00.631981 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a231e796-e4cf-4eab-8fdc-a180e67c6a89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:00.635663 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a231e796-e4cf-4eab-8fdc-a180e67c6a89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.280176 May 09 23:05:00.635663 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 161/325] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:00 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:01.104303 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-3bca13df-b18c-4be1-98cb-c8bd9235a9df tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:01.104898 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-3bca13df-b18c-4be1-98cb-c8bd9235a9df tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:01.113561 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3bca13df-b18c-4be1-98cb-c8bd9235a9df tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:01.113949 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3bca13df-b18c-4be1-98cb-c8bd9235a9df tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:01.114750 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3bca13df-b18c-4be1-98cb-c8bd9235a9df tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:01.115197 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3bca13df-b18c-4be1-98cb-c8bd9235a9df tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:01.240132 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3bca13df-b18c-4be1-98cb-c8bd9235a9df tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:01.247375 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-3bca13df-b18c-4be1-98cb-c8bd9235a9df tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1547 microversion: 2.1 time: 0.146952 May 09 23:05:01.247949 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 165/326] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:01 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:01.263805 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-3374dcc9-d300-4db0-b77d-24b106a475a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:01.264418 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-3374dcc9-d300-4db0-b77d-24b106a475a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:01.270550 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3374dcc9-d300-4db0-b77d-24b106a475a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:01.270997 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3374dcc9-d300-4db0-b77d-24b106a475a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:01.271756 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3374dcc9-d300-4db0-b77d-24b106a475a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:01.272182 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3374dcc9-d300-4db0-b77d-24b106a475a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:01.398069 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-3374dcc9-d300-4db0-b77d-24b106a475a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:01.406054 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-3374dcc9-d300-4db0-b77d-24b106a475a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1547 microversion: 2.1 time: 0.145977 May 09 23:05:01.406670 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 162/327] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:01 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1547 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:01.421417 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-769636e4-79d2-4fea-be36-7124c530954e tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:01.424979 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-769636e4-79d2-4fea-be36-7124c530954e tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:01.425739 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-769636e4-79d2-4fea-be36-7124c530954e tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Searching by: {'deleted': False, 'project_id': '93df4f41ba52453dabfd21f82cb9238b'} {{(pid=117143) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 09 23:05:01.432188 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-769636e4-79d2-4fea-be36-7124c530954e tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:01.432633 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-769636e4-79d2-4fea-be36-7124c530954e tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:01.433430 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-769636e4-79d2-4fea-be36-7124c530954e tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:01.433858 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-769636e4-79d2-4fea-be36-7124c530954e tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:01.528363 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.multi_cell_list [None req-769636e4-79d2-4fea-be36-7124c530954e tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117143) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 09 23:05:01.581079 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f1dc7c26-2046-4110-9328-0a3ef39e79dc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:01.582004 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f1dc7c26-2046-4110-9328-0a3ef39e79dc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:01.588271 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f1dc7c26-2046-4110-9328-0a3ef39e79dc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:01.589573 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f1dc7c26-2046-4110-9328-0a3ef39e79dc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:01.590700 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f1dc7c26-2046-4110-9328-0a3ef39e79dc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:01.591371 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f1dc7c26-2046-4110-9328-0a3ef39e79dc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:01.629160 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-769636e4-79d2-4fea-be36-7124c530954e tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.211417 May 09 23:05:01.629759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 166/328] 10.222.0.23 () {58 vars in 1124 bytes} [Mon May 9 23:05:01 2022] GET /compute/v2.1/servers => generated 343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:05:01.644977 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c3adba94-26f9-4afc-a5f4-69823b0e6900 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:01.645672 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c3adba94-26f9-4afc-a5f4-69823b0e6900 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:01.652125 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c3adba94-26f9-4afc-a5f4-69823b0e6900 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:01.652582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c3adba94-26f9-4afc-a5f4-69823b0e6900 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:01.653363 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c3adba94-26f9-4afc-a5f4-69823b0e6900 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:01.653795 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c3adba94-26f9-4afc-a5f4-69823b0e6900 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:01.666328 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f1dc7c26-2046-4110-9328-0a3ef39e79dc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:01.675586 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f1dc7c26-2046-4110-9328-0a3ef39e79dc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1289 microversion: 2.1 time: 0.100009 May 09 23:05:01.686916 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 163/329] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:01 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1289 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:05:01.692380 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9bbc6dce-3ebb-418a-8ce5-e32cd6a3da7f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:01.693018 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9bbc6dce-3ebb-418a-8ce5-e32cd6a3da7f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:01.699170 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9bbc6dce-3ebb-418a-8ce5-e32cd6a3da7f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:01.699616 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9bbc6dce-3ebb-418a-8ce5-e32cd6a3da7f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:01.700699 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9bbc6dce-3ebb-418a-8ce5-e32cd6a3da7f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:01.701188 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9bbc6dce-3ebb-418a-8ce5-e32cd6a3da7f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:01.795547 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c3adba94-26f9-4afc-a5f4-69823b0e6900 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:01.803440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c3adba94-26f9-4afc-a5f4-69823b0e6900 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1547 microversion: 2.1 time: 0.163024 May 09 23:05:01.804605 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 167/330] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:01 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:01.881781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-9bbc6dce-3ebb-418a-8ce5-e32cd6a3da7f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:01.890900 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-9bbc6dce-3ebb-418a-8ce5-e32cd6a3da7f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:01.892589 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-9bbc6dce-3ebb-418a-8ce5-e32cd6a3da7f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:01.893870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9bbc6dce-3ebb-418a-8ce5-e32cd6a3da7f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.205622 May 09 23:05:01.894568 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 164/331] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:01 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:02.692803 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-951f9226-b4d4-4066-adec-3384e40efc58 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:02.693498 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-951f9226-b4d4-4066-adec-3384e40efc58 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:02.700199 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-951f9226-b4d4-4066-adec-3384e40efc58 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:02.700657 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-951f9226-b4d4-4066-adec-3384e40efc58 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:02.702559 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-951f9226-b4d4-4066-adec-3384e40efc58 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:02.703000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-951f9226-b4d4-4066-adec-3384e40efc58 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:02.833237 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-951f9226-b4d4-4066-adec-3384e40efc58 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:02.840342 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-951f9226-b4d4-4066-adec-3384e40efc58 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1319 microversion: 2.1 time: 0.151366 May 09 23:05:02.840909 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 168/332] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:02 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:02.900486 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-87f69809-ce0c-455f-b4da-fb94f55aa348 req-40653c53-4618-4a4a-972c-4cdb09fccee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e5e8a34-6fc9-49eb-a769-63373d0dc44c", "tag": "7094aec5-e92d-435e-a8e8-152cdb7a3cc2"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:05:02.911051 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-87f69809-ce0c-455f-b4da-fb94f55aa348 req-40653c53-4618-4a4a-972c-4cdb09fccee7 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:02.911512 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-87f69809-ce0c-455f-b4da-fb94f55aa348 req-40653c53-4618-4a4a-972c-4cdb09fccee7 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:02.912844 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-3feaebfe-c48d-4e4b-b119-c8372caaca84 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:02.913458 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-3feaebfe-c48d-4e4b-b119-c8372caaca84 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:02.919508 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3feaebfe-c48d-4e4b-b119-c8372caaca84 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:02.920704 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3feaebfe-c48d-4e4b-b119-c8372caaca84 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:02.921638 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3feaebfe-c48d-4e4b-b119-c8372caaca84 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:02.922266 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3feaebfe-c48d-4e4b-b119-c8372caaca84 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:02.926730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-87f69809-ce0c-455f-b4da-fb94f55aa348 req-40653c53-4618-4a4a-972c-4cdb09fccee7 service nova] Creating event network-changed:7094aec5-e92d-435e-a8e8-152cdb7a3cc2 for instance 1e5e8a34-6fc9-49eb-a769-63373d0dc44c on hv-cinder-84067 May 09 23:05:02.932948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-87f69809-ce0c-455f-b4da-fb94f55aa348 req-40653c53-4618-4a4a-972c-4cdb09fccee7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037467 May 09 23:05:02.934317 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 165/333] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:05:03.054485 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3feaebfe-c48d-4e4b-b119-c8372caaca84 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:03.062246 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3feaebfe-c48d-4e4b-b119-c8372caaca84 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:03.063731 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3feaebfe-c48d-4e4b-b119-c8372caaca84 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:03.064888 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-3feaebfe-c48d-4e4b-b119-c8372caaca84 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.156670 May 09 23:05:03.065440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 169/334] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:02 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:03.315418 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5045c078-4d20-445b-9d91-ae8d5cd6acb8 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c26e30b3-f769-4898-a256-1675f2d077b0"}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:05:03.316636 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5045c078-4d20-445b-9d91-ae8d5cd6acb8 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:03.322756 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5045c078-4d20-445b-9d91-ae8d5cd6acb8 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:03.323208 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5045c078-4d20-445b-9d91-ae8d5cd6acb8 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:03.323981 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5045c078-4d20-445b-9d91-ae8d5cd6acb8 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:03.324419 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5045c078-4d20-445b-9d91-ae8d5cd6acb8 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:03.856615 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d83c1d7f-3caa-4d5a-a57b-8dcf2a315039 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:03.857493 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d83c1d7f-3caa-4d5a-a57b-8dcf2a315039 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:03.863923 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d83c1d7f-3caa-4d5a-a57b-8dcf2a315039 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:03.864370 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d83c1d7f-3caa-4d5a-a57b-8dcf2a315039 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:03.865135 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d83c1d7f-3caa-4d5a-a57b-8dcf2a315039 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:03.865569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d83c1d7f-3caa-4d5a-a57b-8dcf2a315039 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:03.990492 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d83c1d7f-3caa-4d5a-a57b-8dcf2a315039 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:03.997853 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d83c1d7f-3caa-4d5a-a57b-8dcf2a315039 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1319 microversion: 2.1 time: 0.145075 May 09 23:05:03.998961 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 170/335] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:03 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:05:04.082534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-92ba31c1-5d24-4620-8ad5-ff57aedc7c5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:04.083167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-92ba31c1-5d24-4620-8ad5-ff57aedc7c5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:04.088903 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-92ba31c1-5d24-4620-8ad5-ff57aedc7c5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:04.089347 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-92ba31c1-5d24-4620-8ad5-ff57aedc7c5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:04.090106 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-92ba31c1-5d24-4620-8ad5-ff57aedc7c5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:04.090561 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-92ba31c1-5d24-4620-8ad5-ff57aedc7c5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:04.216565 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-92ba31c1-5d24-4620-8ad5-ff57aedc7c5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:04.224126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-92ba31c1-5d24-4620-8ad5-ff57aedc7c5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:04.225658 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-92ba31c1-5d24-4620-8ad5-ff57aedc7c5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:04.226830 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-92ba31c1-5d24-4620-8ad5-ff57aedc7c5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.148030 May 09 23:05:04.227397 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 171/336] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:04 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:05:04.536584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5045c078-4d20-445b-9d91-ae8d5cd6acb8 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "POST /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.225769 May 09 23:05:04.537258 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 166/337] 10.222.0.23 () {60 vars in 1322 bytes} [Mon May 9 23:05:03 2022] POST /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments => generated 194 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:05:05.015763 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2a3dc7b1-810a-4c33-b77a-259582e67c95 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:05.017478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2a3dc7b1-810a-4c33-b77a-259582e67c95 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:05.024491 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2a3dc7b1-810a-4c33-b77a-259582e67c95 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:05.025086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2a3dc7b1-810a-4c33-b77a-259582e67c95 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:05.025890 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2a3dc7b1-810a-4c33-b77a-259582e67c95 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:05.026361 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2a3dc7b1-810a-4c33-b77a-259582e67c95 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:05.158392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2a3dc7b1-810a-4c33-b77a-259582e67c95 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:05.165448 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2a3dc7b1-810a-4c33-b77a-259582e67c95 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1319 microversion: 2.1 time: 0.154768 May 09 23:05:05.166013 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 172/338] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:05 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:05.245894 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ea2f580c-c386-43a3-b7c0-ef8e5fcf0db1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:05.246558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ea2f580c-c386-43a3-b7c0-ef8e5fcf0db1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:05.253278 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ea2f580c-c386-43a3-b7c0-ef8e5fcf0db1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:05.253724 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ea2f580c-c386-43a3-b7c0-ef8e5fcf0db1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:05.254505 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ea2f580c-c386-43a3-b7c0-ef8e5fcf0db1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:05.254944 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ea2f580c-c386-43a3-b7c0-ef8e5fcf0db1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:05.383762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ea2f580c-c386-43a3-b7c0-ef8e5fcf0db1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:05.391425 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ea2f580c-c386-43a3-b7c0-ef8e5fcf0db1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:05.392937 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ea2f580c-c386-43a3-b7c0-ef8e5fcf0db1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:05.394091 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ea2f580c-c386-43a3-b7c0-ef8e5fcf0db1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.153217 May 09 23:05:05.394680 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 167/339] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:05 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:06.183067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b5fc0fa2-8950-48af-890d-1e7690863ba4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:06.183606 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b5fc0fa2-8950-48af-890d-1e7690863ba4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:06.190586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b5fc0fa2-8950-48af-890d-1e7690863ba4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:06.191038 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b5fc0fa2-8950-48af-890d-1e7690863ba4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:06.191811 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b5fc0fa2-8950-48af-890d-1e7690863ba4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:06.192249 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b5fc0fa2-8950-48af-890d-1e7690863ba4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:06.316153 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b5fc0fa2-8950-48af-890d-1e7690863ba4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:06.323421 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b5fc0fa2-8950-48af-890d-1e7690863ba4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1319 microversion: 2.1 time: 0.144253 May 09 23:05:06.324024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 173/340] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:06 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:06.412132 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-bfdcf71e-76ed-4609-b819-2acfa2903af0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:06.412737 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-bfdcf71e-76ed-4609-b819-2acfa2903af0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:06.418978 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bfdcf71e-76ed-4609-b819-2acfa2903af0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:06.419422 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bfdcf71e-76ed-4609-b819-2acfa2903af0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:06.420795 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bfdcf71e-76ed-4609-b819-2acfa2903af0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:06.421225 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bfdcf71e-76ed-4609-b819-2acfa2903af0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:06.544229 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-bfdcf71e-76ed-4609-b819-2acfa2903af0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:06.552468 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-bfdcf71e-76ed-4609-b819-2acfa2903af0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:06.553955 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-bfdcf71e-76ed-4609-b819-2acfa2903af0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:06.555125 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-bfdcf71e-76ed-4609-b819-2acfa2903af0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.146881 May 09 23:05:06.555690 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 168/341] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:06 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:07.339608 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d03dfd7c-94f3-4adf-8748-077a8ad76786 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:07.340350 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d03dfd7c-94f3-4adf-8748-077a8ad76786 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:07.347277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d03dfd7c-94f3-4adf-8748-077a8ad76786 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:07.347728 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d03dfd7c-94f3-4adf-8748-077a8ad76786 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:07.348502 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d03dfd7c-94f3-4adf-8748-077a8ad76786 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:07.348940 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d03dfd7c-94f3-4adf-8748-077a8ad76786 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:07.478431 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d03dfd7c-94f3-4adf-8748-077a8ad76786 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:07.485886 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d03dfd7c-94f3-4adf-8748-077a8ad76786 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1319 microversion: 2.1 time: 0.150126 May 09 23:05:07.486494 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 174/342] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:07 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:07.573209 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a7b57205-fec9-4b5f-bfd1-2793adab4183 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:07.573822 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a7b57205-fec9-4b5f-bfd1-2793adab4183 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:07.580630 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a7b57205-fec9-4b5f-bfd1-2793adab4183 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:07.581099 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a7b57205-fec9-4b5f-bfd1-2793adab4183 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:07.581874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a7b57205-fec9-4b5f-bfd1-2793adab4183 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:07.582346 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a7b57205-fec9-4b5f-bfd1-2793adab4183 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:07.708210 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a7b57205-fec9-4b5f-bfd1-2793adab4183 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:07.715987 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a7b57205-fec9-4b5f-bfd1-2793adab4183 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:07.717507 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a7b57205-fec9-4b5f-bfd1-2793adab4183 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:07.718726 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a7b57205-fec9-4b5f-bfd1-2793adab4183 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.149602 May 09 23:05:07.719296 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 169/343] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:07 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:08.503267 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-39b20336-0612-4b0e-b780-40c138cb96c6 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:08.503876 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-39b20336-0612-4b0e-b780-40c138cb96c6 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:08.510619 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-39b20336-0612-4b0e-b780-40c138cb96c6 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:08.511061 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-39b20336-0612-4b0e-b780-40c138cb96c6 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:08.511825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-39b20336-0612-4b0e-b780-40c138cb96c6 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:08.512250 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-39b20336-0612-4b0e-b780-40c138cb96c6 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:08.641712 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-39b20336-0612-4b0e-b780-40c138cb96c6 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:08.648821 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-39b20336-0612-4b0e-b780-40c138cb96c6 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1319 microversion: 2.1 time: 0.149406 May 09 23:05:08.649381 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 175/344] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:08 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:08.736857 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a01725b7-18c1-476d-abdb-6311101b1940 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:08.737483 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a01725b7-18c1-476d-abdb-6311101b1940 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:08.743740 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a01725b7-18c1-476d-abdb-6311101b1940 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:08.744189 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a01725b7-18c1-476d-abdb-6311101b1940 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:08.744945 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a01725b7-18c1-476d-abdb-6311101b1940 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:08.745375 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a01725b7-18c1-476d-abdb-6311101b1940 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:08.877517 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a01725b7-18c1-476d-abdb-6311101b1940 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:08.885263 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a01725b7-18c1-476d-abdb-6311101b1940 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:08.886804 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a01725b7-18c1-476d-abdb-6311101b1940 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:08.887955 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a01725b7-18c1-476d-abdb-6311101b1940 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.154946 May 09 23:05:08.888551 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 170/345] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:08 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:09.414517 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-a46b5489-fec2-4017-8718-7949d4b3d4ab req-a39a00fc-a39a-468e-a209-2ebf82ca5f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e5e8a34-6fc9-49eb-a769-63373d0dc44c", "name": "network-vif-plugged", "status": "completed", "tag": "7094aec5-e92d-435e-a8e8-152cdb7a3cc2"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:05:09.424951 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-a46b5489-fec2-4017-8718-7949d4b3d4ab req-a39a00fc-a39a-468e-a209-2ebf82ca5f5a service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:09.425413 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-a46b5489-fec2-4017-8718-7949d4b3d4ab req-a39a00fc-a39a-468e-a209-2ebf82ca5f5a service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:09.436385 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-a46b5489-fec2-4017-8718-7949d4b3d4ab req-a39a00fc-a39a-468e-a209-2ebf82ca5f5a service nova] Creating event network-vif-plugged:7094aec5-e92d-435e-a8e8-152cdb7a3cc2 for instance 1e5e8a34-6fc9-49eb-a769-63373d0dc44c on hv-cinder-84067 May 09 23:05:09.442560 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-a46b5489-fec2-4017-8718-7949d4b3d4ab req-a39a00fc-a39a-468e-a209-2ebf82ca5f5a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031533 May 09 23:05:09.443157 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 176/346] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:05:09.664717 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-88ec4656-2a6b-4a04-a1c1-e3a46f56394f tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:09.665490 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-88ec4656-2a6b-4a04-a1c1-e3a46f56394f tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:09.671259 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-88ec4656-2a6b-4a04-a1c1-e3a46f56394f tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:09.671707 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-88ec4656-2a6b-4a04-a1c1-e3a46f56394f tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:09.672473 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-88ec4656-2a6b-4a04-a1c1-e3a46f56394f tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:09.672941 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-88ec4656-2a6b-4a04-a1c1-e3a46f56394f tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:09.802322 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-88ec4656-2a6b-4a04-a1c1-e3a46f56394f tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:09.809570 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-88ec4656-2a6b-4a04-a1c1-e3a46f56394f tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1319 microversion: 2.1 time: 0.148711 May 09 23:05:09.810723 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 171/347] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:09 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:09.906952 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ce60a8d8-1dec-4f90-987d-e261364b67f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:09.907585 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ce60a8d8-1dec-4f90-987d-e261364b67f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:09.914030 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ce60a8d8-1dec-4f90-987d-e261364b67f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:09.914515 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ce60a8d8-1dec-4f90-987d-e261364b67f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:09.915284 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ce60a8d8-1dec-4f90-987d-e261364b67f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:09.915724 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ce60a8d8-1dec-4f90-987d-e261364b67f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:10.044386 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ce60a8d8-1dec-4f90-987d-e261364b67f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:10.052082 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ce60a8d8-1dec-4f90-987d-e261364b67f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:10.053587 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ce60a8d8-1dec-4f90-987d-e261364b67f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:10.054763 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ce60a8d8-1dec-4f90-987d-e261364b67f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.152737 May 09 23:05:10.055329 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 177/348] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:09 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:10.826092 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f3e411be-9874-4300-8462-545058052edf tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:10.826751 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f3e411be-9874-4300-8462-545058052edf tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:10.833077 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f3e411be-9874-4300-8462-545058052edf tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:10.833524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f3e411be-9874-4300-8462-545058052edf tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:10.834328 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f3e411be-9874-4300-8462-545058052edf tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:10.834765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f3e411be-9874-4300-8462-545058052edf tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:10.960035 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f3e411be-9874-4300-8462-545058052edf tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:10.968268 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f3e411be-9874-4300-8462-545058052edf tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1319 microversion: 2.1 time: 0.145652 May 09 23:05:10.968432 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 172/349] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:10 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:11.072633 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b3d8d346-0dd8-465a-a111-dac127e816bf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:11.073245 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b3d8d346-0dd8-465a-a111-dac127e816bf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:11.080205 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b3d8d346-0dd8-465a-a111-dac127e816bf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:11.080656 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b3d8d346-0dd8-465a-a111-dac127e816bf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:11.081425 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b3d8d346-0dd8-465a-a111-dac127e816bf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:11.081867 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b3d8d346-0dd8-465a-a111-dac127e816bf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:11.208283 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b3d8d346-0dd8-465a-a111-dac127e816bf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:11.215926 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b3d8d346-0dd8-465a-a111-dac127e816bf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:11.218089 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b3d8d346-0dd8-465a-a111-dac127e816bf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:11.219267 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b3d8d346-0dd8-465a-a111-dac127e816bf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.150521 May 09 23:05:11.219830 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 178/350] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:11 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:11.985833 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0f7001f3-c249-4406-8cee-2a68850dc29e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:11.986477 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-0f7001f3-c249-4406-8cee-2a68850dc29e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:11.992779 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0f7001f3-c249-4406-8cee-2a68850dc29e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:11.993230 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0f7001f3-c249-4406-8cee-2a68850dc29e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:11.994020 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0f7001f3-c249-4406-8cee-2a68850dc29e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:11.994474 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0f7001f3-c249-4406-8cee-2a68850dc29e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:12.120910 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-0f7001f3-c249-4406-8cee-2a68850dc29e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:12.128758 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0f7001f3-c249-4406-8cee-2a68850dc29e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1509 microversion: 2.1 time: 0.148308 May 09 23:05:12.129332 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 173/351] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:11 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:12.237904 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c5b1922c-579b-42bd-8dc9-ad390b1c4e8b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:12.238572 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c5b1922c-579b-42bd-8dc9-ad390b1c4e8b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:12.245052 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c5b1922c-579b-42bd-8dc9-ad390b1c4e8b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:12.245502 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c5b1922c-579b-42bd-8dc9-ad390b1c4e8b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:12.246302 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c5b1922c-579b-42bd-8dc9-ad390b1c4e8b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:12.246738 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c5b1922c-579b-42bd-8dc9-ad390b1c4e8b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:12.383544 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c5b1922c-579b-42bd-8dc9-ad390b1c4e8b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:12.392084 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c5b1922c-579b-42bd-8dc9-ad390b1c4e8b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:12.393678 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c5b1922c-579b-42bd-8dc9-ad390b1c4e8b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:12.395035 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c5b1922c-579b-42bd-8dc9-ad390b1c4e8b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.161473 May 09 23:05:12.395594 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 179/352] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:12 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:13.119255 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5aa0da05-bfe3-406f-9152-94ab8b8f6415 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:13.119867 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5aa0da05-bfe3-406f-9152-94ab8b8f6415 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:13.126144 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5aa0da05-bfe3-406f-9152-94ab8b8f6415 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:13.126607 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5aa0da05-bfe3-406f-9152-94ab8b8f6415 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:13.127372 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5aa0da05-bfe3-406f-9152-94ab8b8f6415 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:13.127807 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5aa0da05-bfe3-406f-9152-94ab8b8f6415 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:13.255871 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5aa0da05-bfe3-406f-9152-94ab8b8f6415 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:13.263596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5aa0da05-bfe3-406f-9152-94ab8b8f6415 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1593 microversion: 2.1 time: 0.148522 May 09 23:05:13.264164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 174/353] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:13 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1593 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:13.414432 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-3a8e49e5-7565-4fc1-81b7-8bb02815d23a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:13.414987 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-3a8e49e5-7565-4fc1-81b7-8bb02815d23a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:13.421392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3a8e49e5-7565-4fc1-81b7-8bb02815d23a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:13.421840 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3a8e49e5-7565-4fc1-81b7-8bb02815d23a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:13.422638 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3a8e49e5-7565-4fc1-81b7-8bb02815d23a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:13.423073 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3a8e49e5-7565-4fc1-81b7-8bb02815d23a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:13.560658 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3a8e49e5-7565-4fc1-81b7-8bb02815d23a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:13.569304 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3a8e49e5-7565-4fc1-81b7-8bb02815d23a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:13.571826 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3a8e49e5-7565-4fc1-81b7-8bb02815d23a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:13.573591 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-3a8e49e5-7565-4fc1-81b7-8bb02815d23a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1744 microversion: 2.20 time: 0.162858 May 09 23:05:13.575033 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 180/354] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:13 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:14.593115 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-142ed162-a665-4ca4-8837-15e727847cd5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:14.594101 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-142ed162-a665-4ca4-8837-15e727847cd5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:14.600406 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-142ed162-a665-4ca4-8837-15e727847cd5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:14.600867 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-142ed162-a665-4ca4-8837-15e727847cd5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:14.601645 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-142ed162-a665-4ca4-8837-15e727847cd5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:14.602081 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-142ed162-a665-4ca4-8837-15e727847cd5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:14.818406 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-142ed162-a665-4ca4-8837-15e727847cd5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:14.827453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-142ed162-a665-4ca4-8837-15e727847cd5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:14.829071 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-142ed162-a665-4ca4-8837-15e727847cd5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:14.830323 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-142ed162-a665-4ca4-8837-15e727847cd5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1744 microversion: 2.20 time: 0.241631 May 09 23:05:14.830890 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 175/355] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:14 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1744 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:15.091176 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-b13a1604-f99e-4f35-8f69-dc231f403794 req-99a5e40e-3cf3-48ff-bd61-78fee167b2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93373b9f-f998-4983-9b08-7b874cf7c76e", "tag": "49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:05:15.101998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-b13a1604-f99e-4f35-8f69-dc231f403794 req-99a5e40e-3cf3-48ff-bd61-78fee167b2f9 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:15.102487 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-b13a1604-f99e-4f35-8f69-dc231f403794 req-99a5e40e-3cf3-48ff-bd61-78fee167b2f9 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:15.116112 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-b13a1604-f99e-4f35-8f69-dc231f403794 req-99a5e40e-3cf3-48ff-bd61-78fee167b2f9 service nova] Creating event network-changed:49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787 for instance 93373b9f-f998-4983-9b08-7b874cf7c76e on hv-cinder-84067 May 09 23:05:15.121759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-b13a1604-f99e-4f35-8f69-dc231f403794 req-99a5e40e-3cf3-48ff-bd61-78fee167b2f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034162 May 09 23:05:15.122841 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 181/356] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:05:15.850408 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c026cad6-0615-47d3-ad16-01d9c07424b6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:15.850971 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c026cad6-0615-47d3-ad16-01d9c07424b6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:15.861975 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c026cad6-0615-47d3-ad16-01d9c07424b6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:15.862898 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c026cad6-0615-47d3-ad16-01d9c07424b6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:15.865541 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c026cad6-0615-47d3-ad16-01d9c07424b6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:15.867956 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c026cad6-0615-47d3-ad16-01d9c07424b6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:16.397533 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c026cad6-0615-47d3-ad16-01d9c07424b6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:16.414655 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c026cad6-0615-47d3-ad16-01d9c07424b6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:16.416330 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c026cad6-0615-47d3-ad16-01d9c07424b6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:16.417753 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c026cad6-0615-47d3-ad16-01d9c07424b6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1739 microversion: 2.20 time: 0.572316 May 09 23:05:16.419298 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 176/357] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:15 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1739 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:16.554806 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f06a7721-cd5a-4295-abef-801c18f0c05b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1330116907"}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:05:16.557293 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f06a7721-cd5a-4295-abef-801c18f0c05b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:16.566421 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f06a7721-cd5a-4295-abef-801c18f0c05b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:16.567780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f06a7721-cd5a-4295-abef-801c18f0c05b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:16.568781 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f06a7721-cd5a-4295-abef-801c18f0c05b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:16.569373 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f06a7721-cd5a-4295-abef-801c18f0c05b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:16.765349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.network.security_group_api [None req-f06a7721-cd5a-4295-abef-801c18f0c05b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Adding security group c3c34fa7-022c-4947-82d8-84d73b758654 to port 49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787 May 09 23:05:17.321437 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f06a7721-cd5a-4295-abef-801c18f0c05b tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "POST /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/action" status: 202 len: 0 microversion: 2.1 time: 0.777005 May 09 23:05:17.322134 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 182/358] 10.222.0.23 () {60 vars in 1277 bytes} [Mon May 9 23:05:16 2022] POST /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/action => generated 0 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:05:17.341039 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-abeb7ada-da63-43a7-be46-6ef5f4919521 req-6a985cb9-d3da-453e-a93a-bd6e05652c3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93373b9f-f998-4983-9b08-7b874cf7c76e", "tag": "49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:05:17.343316 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a9bad41b-9cac-41e9-bdd9-3dc36a274701 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:17.348516 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a9bad41b-9cac-41e9-bdd9-3dc36a274701 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:17.364572 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-abeb7ada-da63-43a7-be46-6ef5f4919521 req-6a985cb9-d3da-453e-a93a-bd6e05652c3c service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:17.365234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-abeb7ada-da63-43a7-be46-6ef5f4919521 req-6a985cb9-d3da-453e-a93a-bd6e05652c3c service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:17.377196 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a9bad41b-9cac-41e9-bdd9-3dc36a274701 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:17.378035 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a9bad41b-9cac-41e9-bdd9-3dc36a274701 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:17.379084 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a9bad41b-9cac-41e9-bdd9-3dc36a274701 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:17.379738 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a9bad41b-9cac-41e9-bdd9-3dc36a274701 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:17.391881 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-abeb7ada-da63-43a7-be46-6ef5f4919521 req-6a985cb9-d3da-453e-a93a-bd6e05652c3c service nova] Creating event network-changed:49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787 for instance 93373b9f-f998-4983-9b08-7b874cf7c76e on hv-cinder-84067 May 09 23:05:17.401837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-abeb7ada-da63-43a7-be46-6ef5f4919521 req-6a985cb9-d3da-453e-a93a-bd6e05652c3c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064429 May 09 23:05:17.403234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 183/359] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:05:17.439803 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-45253501-045b-4059-a563-1bac0f085458 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:17.443211 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-45253501-045b-4059-a563-1bac0f085458 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:17.463693 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-45253501-045b-4059-a563-1bac0f085458 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:17.464584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-45253501-045b-4059-a563-1bac0f085458 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:17.465826 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-45253501-045b-4059-a563-1bac0f085458 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:17.466531 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-45253501-045b-4059-a563-1bac0f085458 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:17.751578 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a9bad41b-9cac-41e9-bdd9-3dc36a274701 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:17.773841 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-45253501-045b-4059-a563-1bac0f085458 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:17.775300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a9bad41b-9cac-41e9-bdd9-3dc36a274701 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1759 microversion: 2.1 time: 0.446741 May 09 23:05:17.775918 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 177/360] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:17 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1759 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:17.799746 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-45253501-045b-4059-a563-1bac0f085458 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:17.801962 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-45253501-045b-4059-a563-1bac0f085458 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:17.803417 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-45253501-045b-4059-a563-1bac0f085458 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1739 microversion: 2.20 time: 0.368894 May 09 23:05:17.814135 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 184/361] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:17 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1739 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:17.964632 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-8aca9cc8-c03c-4a7d-8ebb-17e40c2937a1 req-1d4b10bf-c900-4667-8576-a1a7f72c8fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5734d5-da65-4ee8-8684-e236f56da50a", "name": "network-vif-plugged", "status": "completed", "tag": "9b2aff87-eeca-44a4-b616-becbcd5f1d58"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:05:17.976326 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-8aca9cc8-c03c-4a7d-8ebb-17e40c2937a1 req-1d4b10bf-c900-4667-8576-a1a7f72c8fe8 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:17.976829 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-8aca9cc8-c03c-4a7d-8ebb-17e40c2937a1 req-1d4b10bf-c900-4667-8576-a1a7f72c8fe8 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:18.010625 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-8aca9cc8-c03c-4a7d-8ebb-17e40c2937a1 req-1d4b10bf-c900-4667-8576-a1a7f72c8fe8 service nova] Creating event network-vif-plugged:9b2aff87-eeca-44a4-b616-becbcd5f1d58 for instance 2e5734d5-da65-4ee8-8684-e236f56da50a on hv-cinder-84067 May 09 23:05:18.026560 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-8aca9cc8-c03c-4a7d-8ebb-17e40c2937a1 req-1d4b10bf-c900-4667-8576-a1a7f72c8fe8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065459 May 09 23:05:18.028665 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 178/362] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:05:18.821888 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1dd91320-b801-4d14-8cf9-e44c0f59696c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:18.823276 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1dd91320-b801-4d14-8cf9-e44c0f59696c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:18.830799 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1dd91320-b801-4d14-8cf9-e44c0f59696c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:18.831805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1dd91320-b801-4d14-8cf9-e44c0f59696c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:18.832962 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1dd91320-b801-4d14-8cf9-e44c0f59696c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:18.833475 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1dd91320-b801-4d14-8cf9-e44c0f59696c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:19.005638 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1dd91320-b801-4d14-8cf9-e44c0f59696c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:19.016487 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1dd91320-b801-4d14-8cf9-e44c0f59696c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:19.017982 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1dd91320-b801-4d14-8cf9-e44c0f59696c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:19.019354 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1dd91320-b801-4d14-8cf9-e44c0f59696c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1739 microversion: 2.20 time: 0.201834 May 09 23:05:19.020220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 185/363] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:18 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:20.039403 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-b2f14e96-f112-4434-9c00-a04d1e31a72a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:20.040100 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-b2f14e96-f112-4434-9c00-a04d1e31a72a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:20.047169 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b2f14e96-f112-4434-9c00-a04d1e31a72a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:20.047619 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b2f14e96-f112-4434-9c00-a04d1e31a72a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:20.048588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b2f14e96-f112-4434-9c00-a04d1e31a72a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:20.049083 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b2f14e96-f112-4434-9c00-a04d1e31a72a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:20.203299 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-b2f14e96-f112-4434-9c00-a04d1e31a72a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:20.212020 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-b2f14e96-f112-4434-9c00-a04d1e31a72a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:20.213790 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-b2f14e96-f112-4434-9c00-a04d1e31a72a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:20.215170 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-b2f14e96-f112-4434-9c00-a04d1e31a72a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1739 microversion: 2.20 time: 0.180515 May 09 23:05:20.216146 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 179/364] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:20 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:21.233818 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a61eaff2-31e5-450a-93fd-63e3802590f6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:21.234885 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a61eaff2-31e5-450a-93fd-63e3802590f6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:21.241551 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a61eaff2-31e5-450a-93fd-63e3802590f6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:21.242256 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a61eaff2-31e5-450a-93fd-63e3802590f6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:21.243805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a61eaff2-31e5-450a-93fd-63e3802590f6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:21.243805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a61eaff2-31e5-450a-93fd-63e3802590f6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:21.408332 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a61eaff2-31e5-450a-93fd-63e3802590f6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:21.416523 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a61eaff2-31e5-450a-93fd-63e3802590f6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:21.418029 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a61eaff2-31e5-450a-93fd-63e3802590f6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:21.421050 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a61eaff2-31e5-450a-93fd-63e3802590f6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1739 microversion: 2.20 time: 0.191257 May 09 23:05:21.422687 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 186/365] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:21 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:22.442780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-2088bf74-7426-45d5-bc9c-bebd8da8ab75 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:22.444158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-2088bf74-7426-45d5-bc9c-bebd8da8ab75 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:22.451372 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2088bf74-7426-45d5-bc9c-bebd8da8ab75 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:22.451889 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2088bf74-7426-45d5-bc9c-bebd8da8ab75 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:22.452757 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2088bf74-7426-45d5-bc9c-bebd8da8ab75 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:22.453260 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2088bf74-7426-45d5-bc9c-bebd8da8ab75 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:22.612744 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-2088bf74-7426-45d5-bc9c-bebd8da8ab75 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:22.620881 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-2088bf74-7426-45d5-bc9c-bebd8da8ab75 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:22.622945 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-2088bf74-7426-45d5-bc9c-bebd8da8ab75 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:22.624696 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-2088bf74-7426-45d5-bc9c-bebd8da8ab75 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1739 microversion: 2.20 time: 0.186940 May 09 23:05:22.625457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 180/366] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:22 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:23.643110 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e31cf9ad-498b-498d-ad68-4f4915018b39 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:23.643900 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e31cf9ad-498b-498d-ad68-4f4915018b39 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:23.651439 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e31cf9ad-498b-498d-ad68-4f4915018b39 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:23.651997 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e31cf9ad-498b-498d-ad68-4f4915018b39 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:23.653010 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e31cf9ad-498b-498d-ad68-4f4915018b39 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:23.653448 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e31cf9ad-498b-498d-ad68-4f4915018b39 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:23.813170 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e31cf9ad-498b-498d-ad68-4f4915018b39 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:23.824865 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e31cf9ad-498b-498d-ad68-4f4915018b39 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:23.826643 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e31cf9ad-498b-498d-ad68-4f4915018b39 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:23.828650 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e31cf9ad-498b-498d-ad68-4f4915018b39 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1739 microversion: 2.20 time: 0.189204 May 09 23:05:23.829926 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 187/367] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:23 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:24.849876 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-73123682-4ec9-4abb-a525-dea9e226c1ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:24.850525 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-73123682-4ec9-4abb-a525-dea9e226c1ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:24.857351 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-73123682-4ec9-4abb-a525-dea9e226c1ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:24.858187 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-73123682-4ec9-4abb-a525-dea9e226c1ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:24.859195 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-73123682-4ec9-4abb-a525-dea9e226c1ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:24.859824 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-73123682-4ec9-4abb-a525-dea9e226c1ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:25.002064 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-73123682-4ec9-4abb-a525-dea9e226c1ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:25.010401 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-73123682-4ec9-4abb-a525-dea9e226c1ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:25.012027 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-73123682-4ec9-4abb-a525-dea9e226c1ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:25.013263 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-73123682-4ec9-4abb-a525-dea9e226c1ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1739 microversion: 2.20 time: 0.167207 May 09 23:05:25.014431 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 181/368] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:24 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:26.031981 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1e2b7ed1-2d8b-4513-9c3e-acacf8706db8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:26.033176 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1e2b7ed1-2d8b-4513-9c3e-acacf8706db8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:26.039536 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1e2b7ed1-2d8b-4513-9c3e-acacf8706db8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:26.039988 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1e2b7ed1-2d8b-4513-9c3e-acacf8706db8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:26.040762 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1e2b7ed1-2d8b-4513-9c3e-acacf8706db8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:26.041198 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1e2b7ed1-2d8b-4513-9c3e-acacf8706db8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:26.173328 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1e2b7ed1-2d8b-4513-9c3e-acacf8706db8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:26.181050 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1e2b7ed1-2d8b-4513-9c3e-acacf8706db8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:26.182614 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1e2b7ed1-2d8b-4513-9c3e-acacf8706db8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:26.183771 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1e2b7ed1-2d8b-4513-9c3e-acacf8706db8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1739 microversion: 2.20 time: 0.155846 May 09 23:05:26.184333 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 188/369] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:26 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:27.203109 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-579c96d5-a438-47ce-b5ef-56d641628361 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:27.203722 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-579c96d5-a438-47ce-b5ef-56d641628361 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:27.210006 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-579c96d5-a438-47ce-b5ef-56d641628361 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:27.210441 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-579c96d5-a438-47ce-b5ef-56d641628361 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:27.211222 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-579c96d5-a438-47ce-b5ef-56d641628361 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:27.211669 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-579c96d5-a438-47ce-b5ef-56d641628361 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:27.345176 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-579c96d5-a438-47ce-b5ef-56d641628361 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:27.352913 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-579c96d5-a438-47ce-b5ef-56d641628361 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:27.354435 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-579c96d5-a438-47ce-b5ef-56d641628361 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:27.355575 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-579c96d5-a438-47ce-b5ef-56d641628361 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1721 microversion: 2.20 time: 0.156939 May 09 23:05:27.356132 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 182/370] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:27 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:28.373555 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ca228cb8-a3b9-47e2-bc2a-df4b98562498 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:28.374234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ca228cb8-a3b9-47e2-bc2a-df4b98562498 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:28.380710 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ca228cb8-a3b9-47e2-bc2a-df4b98562498 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:28.381133 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ca228cb8-a3b9-47e2-bc2a-df4b98562498 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:28.381902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ca228cb8-a3b9-47e2-bc2a-df4b98562498 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:28.382367 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ca228cb8-a3b9-47e2-bc2a-df4b98562498 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:28.508266 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ca228cb8-a3b9-47e2-bc2a-df4b98562498 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:28.516932 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ca228cb8-a3b9-47e2-bc2a-df4b98562498 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:28.518473 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ca228cb8-a3b9-47e2-bc2a-df4b98562498 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:28.519638 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ca228cb8-a3b9-47e2-bc2a-df4b98562498 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1721 microversion: 2.20 time: 0.149959 May 09 23:05:28.520202 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 189/371] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:28 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:29.479941 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-b18e32f0-a3f8-4d84-ba3d-0c6050db5a82 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06357bc0-afd0-49a5-b26c-88912f02995c", "device": "/dev/sdb"}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:05:29.481509 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-b18e32f0-a3f8-4d84-ba3d-0c6050db5a82 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:29.488730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b18e32f0-a3f8-4d84-ba3d-0c6050db5a82 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:29.489185 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b18e32f0-a3f8-4d84-ba3d-0c6050db5a82 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:29.489958 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b18e32f0-a3f8-4d84-ba3d-0c6050db5a82 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:29.490437 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b18e32f0-a3f8-4d84-ba3d-0c6050db5a82 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:29.537525 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ae33ff0f-2ed4-4e9b-883c-5fe8817252cd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:29.538046 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ae33ff0f-2ed4-4e9b-883c-5fe8817252cd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:29.544257 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae33ff0f-2ed4-4e9b-883c-5fe8817252cd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:29.544707 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae33ff0f-2ed4-4e9b-883c-5fe8817252cd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:29.546049 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae33ff0f-2ed4-4e9b-883c-5fe8817252cd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:29.546528 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae33ff0f-2ed4-4e9b-883c-5fe8817252cd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:29.681211 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ae33ff0f-2ed4-4e9b-883c-5fe8817252cd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:29.688946 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ae33ff0f-2ed4-4e9b-883c-5fe8817252cd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:29.692620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ae33ff0f-2ed4-4e9b-883c-5fe8817252cd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:29.693897 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ae33ff0f-2ed4-4e9b-883c-5fe8817252cd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1724 microversion: 2.20 time: 0.160447 May 09 23:05:29.694569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 190/372] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:29 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:05:29.715414 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-bd73fcbb-58ea-44a0-a83c-17f012875d85 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81919e77-dc91-4581-8fa8-3b5c46c1a528"}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:05:29.718140 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-bd73fcbb-58ea-44a0-a83c-17f012875d85 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:29.723228 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bd73fcbb-58ea-44a0-a83c-17f012875d85 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:29.723681 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bd73fcbb-58ea-44a0-a83c-17f012875d85 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:29.724468 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bd73fcbb-58ea-44a0-a83c-17f012875d85 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:29.724906 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bd73fcbb-58ea-44a0-a83c-17f012875d85 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:29.766923 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-b18e32f0-a3f8-4d84-ba3d-0c6050db5a82 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "POST /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290675 May 09 23:05:29.767664 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 183/373] 10.222.0.23 () {60 vars in 1322 bytes} [Mon May 9 23:05:29 2022] POST /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:05:30.012779 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-bd73fcbb-58ea-44a0-a83c-17f012875d85 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "POST /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304441 May 09 23:05:30.013390 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 191/374] 10.222.0.23 () {62 vars in 1363 bytes} [Mon May 9 23:05:29 2022] POST /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 23:05:30.128592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-258f3fa3-c8f9-4f77-94ef-9bbf22522cce tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:05:30.129235 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-258f3fa3-c8f9-4f77-94ef-9bbf22522cce tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:30.135222 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-258f3fa3-c8f9-4f77-94ef-9bbf22522cce tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:30.135669 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-258f3fa3-c8f9-4f77-94ef-9bbf22522cce tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:30.136429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-258f3fa3-c8f9-4f77-94ef-9bbf22522cce tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:30.136862 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-258f3fa3-c8f9-4f77-94ef-9bbf22522cce tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:30.226095 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-258f3fa3-c8f9-4f77-94ef-9bbf22522cce tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "POST /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/action" status: 202 len: 0 microversion: 2.20 time: 0.102545 May 09 23:05:30.226876 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 184/375] 10.222.0.23 () {62 vars in 1318 bytes} [Mon May 9 23:05:30 2022] POST /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 23:05:30.235996 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a33398c8-53db-481a-8bcc-feb442cf1cc7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:30.237288 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a33398c8-53db-481a-8bcc-feb442cf1cc7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:30.243573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a33398c8-53db-481a-8bcc-feb442cf1cc7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:30.244157 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a33398c8-53db-481a-8bcc-feb442cf1cc7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:30.245701 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a33398c8-53db-481a-8bcc-feb442cf1cc7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:30.246258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a33398c8-53db-481a-8bcc-feb442cf1cc7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:30.377515 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a33398c8-53db-481a-8bcc-feb442cf1cc7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:30.385781 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a33398c8-53db-481a-8bcc-feb442cf1cc7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:30.387304 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a33398c8-53db-481a-8bcc-feb442cf1cc7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:30.388448 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a33398c8-53db-481a-8bcc-feb442cf1cc7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1750 microversion: 2.20 time: 0.157446 May 09 23:05:30.389018 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 192/376] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:30 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:31.409263 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d9530f38-9b2f-4735-b1a3-02faad7498da tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:31.409884 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-d9530f38-9b2f-4735-b1a3-02faad7498da tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:31.416422 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d9530f38-9b2f-4735-b1a3-02faad7498da tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:31.416878 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d9530f38-9b2f-4735-b1a3-02faad7498da tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:31.417668 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d9530f38-9b2f-4735-b1a3-02faad7498da tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:31.418108 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d9530f38-9b2f-4735-b1a3-02faad7498da tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:31.474900 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-21dd034a-259e-4d85-b74d-aebc2dc88c80 req-c7a4d814-1077-4e0f-b09f-042d9f4c013a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5734d5-da65-4ee8-8684-e236f56da50a", "name": "network-vif-unplugged", "status": "completed", "tag": "9b2aff87-eeca-44a4-b616-becbcd5f1d58"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:05:31.485856 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-21dd034a-259e-4d85-b74d-aebc2dc88c80 req-c7a4d814-1077-4e0f-b09f-042d9f4c013a service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:31.486330 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-21dd034a-259e-4d85-b74d-aebc2dc88c80 req-c7a4d814-1077-4e0f-b09f-042d9f4c013a service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:31.501020 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.compute.server_external_events [req-21dd034a-259e-4d85-b74d-aebc2dc88c80 req-c7a4d814-1077-4e0f-b09f-042d9f4c013a service nova] Unable to find a host for instance 2e5734d5-da65-4ee8-8684-e236f56da50a. Dropping event network-vif-unplugged {{(pid=117143) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 09 23:05:31.501888 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-21dd034a-259e-4d85-b74d-aebc2dc88c80 req-c7a4d814-1077-4e0f-b09f-042d9f4c013a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032058 May 09 23:05:31.502699 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 193/377] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 09 23:05:31.549810 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-d9530f38-9b2f-4735-b1a3-02faad7498da tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:31.558227 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-d9530f38-9b2f-4735-b1a3-02faad7498da tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:31.559729 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-d9530f38-9b2f-4735-b1a3-02faad7498da tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:31.561549 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d9530f38-9b2f-4735-b1a3-02faad7498da tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1752 microversion: 2.20 time: 0.158386 May 09 23:05:31.562137 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 185/378] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:31 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:32.579886 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-3e4b8dfc-f979-4354-83bf-786b212000ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:32.580495 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-3e4b8dfc-f979-4354-83bf-786b212000ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:32.586950 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3e4b8dfc-f979-4354-83bf-786b212000ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:32.587423 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3e4b8dfc-f979-4354-83bf-786b212000ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:32.588184 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3e4b8dfc-f979-4354-83bf-786b212000ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:32.588635 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3e4b8dfc-f979-4354-83bf-786b212000ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:32.717029 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3e4b8dfc-f979-4354-83bf-786b212000ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:32.725032 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3e4b8dfc-f979-4354-83bf-786b212000ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:32.726538 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3e4b8dfc-f979-4354-83bf-786b212000ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:32.727676 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-3e4b8dfc-f979-4354-83bf-786b212000ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1752 microversion: 2.20 time: 0.151630 May 09 23:05:32.728235 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 194/379] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:32 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:33.746359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-786c4d91-0592-4786-9685-eebfb5260497 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:33.746987 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-786c4d91-0592-4786-9685-eebfb5260497 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:33.753149 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-786c4d91-0592-4786-9685-eebfb5260497 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:33.753594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-786c4d91-0592-4786-9685-eebfb5260497 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:33.754381 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-786c4d91-0592-4786-9685-eebfb5260497 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:33.754814 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-786c4d91-0592-4786-9685-eebfb5260497 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:33.881466 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-786c4d91-0592-4786-9685-eebfb5260497 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:33.890076 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-786c4d91-0592-4786-9685-eebfb5260497 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:33.891600 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-786c4d91-0592-4786-9685-eebfb5260497 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:33.892756 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-786c4d91-0592-4786-9685-eebfb5260497 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1752 microversion: 2.20 time: 0.150301 May 09 23:05:33.893320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 186/380] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:33 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:34.910788 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-949d8b25-3654-4c6a-ad28-dda88b16b921 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:34.911333 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-949d8b25-3654-4c6a-ad28-dda88b16b921 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:34.917512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-949d8b25-3654-4c6a-ad28-dda88b16b921 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:34.917952 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-949d8b25-3654-4c6a-ad28-dda88b16b921 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:34.918739 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-949d8b25-3654-4c6a-ad28-dda88b16b921 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:34.919171 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-949d8b25-3654-4c6a-ad28-dda88b16b921 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:35.041552 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-949d8b25-3654-4c6a-ad28-dda88b16b921 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:35.050194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-949d8b25-3654-4c6a-ad28-dda88b16b921 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:35.051724 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-949d8b25-3654-4c6a-ad28-dda88b16b921 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:35.052805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-949d8b25-3654-4c6a-ad28-dda88b16b921 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1752 microversion: 2.20 time: 0.145985 May 09 23:05:35.053361 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 195/381] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:34 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1752 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:36.071177 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a4d17afb-a935-4570-b554-4216cc11cc28 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:36.071781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a4d17afb-a935-4570-b554-4216cc11cc28 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:36.078142 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a4d17afb-a935-4570-b554-4216cc11cc28 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:36.078596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a4d17afb-a935-4570-b554-4216cc11cc28 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:36.079353 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a4d17afb-a935-4570-b554-4216cc11cc28 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:36.079784 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a4d17afb-a935-4570-b554-4216cc11cc28 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:36.208674 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a4d17afb-a935-4570-b554-4216cc11cc28 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:36.217257 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a4d17afb-a935-4570-b554-4216cc11cc28 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:36.218795 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a4d17afb-a935-4570-b554-4216cc11cc28 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:36.219920 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a4d17afb-a935-4570-b554-4216cc11cc28 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1752 microversion: 2.20 time: 0.152586 May 09 23:05:36.220478 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 187/382] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:36 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:37.239791 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e2a3a937-bcc7-4aef-a8ed-fecbbf8d68e2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:37.239791 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e2a3a937-bcc7-4aef-a8ed-fecbbf8d68e2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:37.245479 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e2a3a937-bcc7-4aef-a8ed-fecbbf8d68e2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:37.245925 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e2a3a937-bcc7-4aef-a8ed-fecbbf8d68e2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:37.246820 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e2a3a937-bcc7-4aef-a8ed-fecbbf8d68e2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:37.247249 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e2a3a937-bcc7-4aef-a8ed-fecbbf8d68e2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:37.396575 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e2a3a937-bcc7-4aef-a8ed-fecbbf8d68e2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:37.408470 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e2a3a937-bcc7-4aef-a8ed-fecbbf8d68e2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:37.410309 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e2a3a937-bcc7-4aef-a8ed-fecbbf8d68e2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:37.416289 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e2a3a937-bcc7-4aef-a8ed-fecbbf8d68e2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.177251 May 09 23:05:37.424317 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 196/383] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:37 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:38.431555 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-63a672ed-1854-416e-bd21-37e077d7fd23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:38.432170 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-63a672ed-1854-416e-bd21-37e077d7fd23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:38.438462 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-63a672ed-1854-416e-bd21-37e077d7fd23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:38.438914 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-63a672ed-1854-416e-bd21-37e077d7fd23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:38.439682 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-63a672ed-1854-416e-bd21-37e077d7fd23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:38.440120 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-63a672ed-1854-416e-bd21-37e077d7fd23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:38.568807 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-63a672ed-1854-416e-bd21-37e077d7fd23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:38.577620 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-63a672ed-1854-416e-bd21-37e077d7fd23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:38.579140 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-63a672ed-1854-416e-bd21-37e077d7fd23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:38.580286 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-63a672ed-1854-416e-bd21-37e077d7fd23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.152601 May 09 23:05:38.580847 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 188/384] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:38 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:39.598685 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ae58513b-6b25-41fc-aa20-6e1ec4b106de tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:39.599191 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ae58513b-6b25-41fc-aa20-6e1ec4b106de tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:39.605394 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae58513b-6b25-41fc-aa20-6e1ec4b106de tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:39.605831 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae58513b-6b25-41fc-aa20-6e1ec4b106de tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:39.606879 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae58513b-6b25-41fc-aa20-6e1ec4b106de tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:39.607314 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae58513b-6b25-41fc-aa20-6e1ec4b106de tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:39.732437 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ae58513b-6b25-41fc-aa20-6e1ec4b106de tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:39.740601 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ae58513b-6b25-41fc-aa20-6e1ec4b106de tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:39.742090 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ae58513b-6b25-41fc-aa20-6e1ec4b106de tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:39.743268 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ae58513b-6b25-41fc-aa20-6e1ec4b106de tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.148557 May 09 23:05:39.743835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 197/385] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:39 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:40.761926 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cefc645d-536d-4bf8-816a-ccb2f7dbee19 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:40.762745 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cefc645d-536d-4bf8-816a-ccb2f7dbee19 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:40.771089 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cefc645d-536d-4bf8-816a-ccb2f7dbee19 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:40.771691 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cefc645d-536d-4bf8-816a-ccb2f7dbee19 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:40.772758 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cefc645d-536d-4bf8-816a-ccb2f7dbee19 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:40.773286 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cefc645d-536d-4bf8-816a-ccb2f7dbee19 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:40.933537 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cefc645d-536d-4bf8-816a-ccb2f7dbee19 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:40.942317 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cefc645d-536d-4bf8-816a-ccb2f7dbee19 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:40.943824 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cefc645d-536d-4bf8-816a-ccb2f7dbee19 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:40.944999 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cefc645d-536d-4bf8-816a-ccb2f7dbee19 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.188164 May 09 23:05:40.955797 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 189/386] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:40 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:41.962918 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b36b5d57-bc77-4334-b708-ef9509288b2f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:41.963589 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b36b5d57-bc77-4334-b708-ef9509288b2f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:41.970244 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b36b5d57-bc77-4334-b708-ef9509288b2f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:41.970806 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b36b5d57-bc77-4334-b708-ef9509288b2f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:41.971652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b36b5d57-bc77-4334-b708-ef9509288b2f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:41.972164 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b36b5d57-bc77-4334-b708-ef9509288b2f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:42.102873 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b36b5d57-bc77-4334-b708-ef9509288b2f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:42.112355 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b36b5d57-bc77-4334-b708-ef9509288b2f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:42.114106 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b36b5d57-bc77-4334-b708-ef9509288b2f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:42.115296 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b36b5d57-bc77-4334-b708-ef9509288b2f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.156352 May 09 23:05:42.115863 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 198/387] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:41 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:05:43.134552 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cd94a189-9635-4620-8708-b0aca59cf29f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:43.135273 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cd94a189-9635-4620-8708-b0aca59cf29f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:43.141684 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd94a189-9635-4620-8708-b0aca59cf29f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:43.142248 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd94a189-9635-4620-8708-b0aca59cf29f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:43.143061 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd94a189-9635-4620-8708-b0aca59cf29f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:43.143503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd94a189-9635-4620-8708-b0aca59cf29f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:43.275988 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cd94a189-9635-4620-8708-b0aca59cf29f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:43.285102 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cd94a189-9635-4620-8708-b0aca59cf29f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:43.286806 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cd94a189-9635-4620-8708-b0aca59cf29f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:43.288037 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cd94a189-9635-4620-8708-b0aca59cf29f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.157367 May 09 23:05:43.290623 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 190/388] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:43 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:44.306862 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2c92b2bc-28bf-4022-8007-fc10c650a2c1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:44.307479 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2c92b2bc-28bf-4022-8007-fc10c650a2c1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:44.313823 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2c92b2bc-28bf-4022-8007-fc10c650a2c1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:44.315050 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2c92b2bc-28bf-4022-8007-fc10c650a2c1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:44.315835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2c92b2bc-28bf-4022-8007-fc10c650a2c1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:44.316265 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2c92b2bc-28bf-4022-8007-fc10c650a2c1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:44.456256 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2c92b2bc-28bf-4022-8007-fc10c650a2c1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:44.465732 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2c92b2bc-28bf-4022-8007-fc10c650a2c1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:44.467438 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2c92b2bc-28bf-4022-8007-fc10c650a2c1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:44.468633 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2c92b2bc-28bf-4022-8007-fc10c650a2c1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.165645 May 09 23:05:44.469200 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 199/389] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:44 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:45.486459 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-750a4cd3-7d2a-4847-becf-f9fb7a80d665 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:45.487066 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-750a4cd3-7d2a-4847-becf-f9fb7a80d665 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:45.493405 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-750a4cd3-7d2a-4847-becf-f9fb7a80d665 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:45.493806 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-750a4cd3-7d2a-4847-becf-f9fb7a80d665 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:45.494607 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-750a4cd3-7d2a-4847-becf-f9fb7a80d665 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:45.495051 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-750a4cd3-7d2a-4847-becf-f9fb7a80d665 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:45.625647 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-750a4cd3-7d2a-4847-becf-f9fb7a80d665 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:45.635776 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-750a4cd3-7d2a-4847-becf-f9fb7a80d665 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:45.637305 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-750a4cd3-7d2a-4847-becf-f9fb7a80d665 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:45.638685 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-750a4cd3-7d2a-4847-becf-f9fb7a80d665 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.156082 May 09 23:05:45.641895 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 191/390] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:45 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:46.657567 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5e9b1fee-e54e-4121-bd96-b50cbcd8ca6e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:46.658546 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-5e9b1fee-e54e-4121-bd96-b50cbcd8ca6e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:46.664984 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5e9b1fee-e54e-4121-bd96-b50cbcd8ca6e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:46.665555 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5e9b1fee-e54e-4121-bd96-b50cbcd8ca6e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:46.667195 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5e9b1fee-e54e-4121-bd96-b50cbcd8ca6e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:46.667642 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5e9b1fee-e54e-4121-bd96-b50cbcd8ca6e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:46.810490 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-5e9b1fee-e54e-4121-bd96-b50cbcd8ca6e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:46.819467 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-5e9b1fee-e54e-4121-bd96-b50cbcd8ca6e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:46.820961 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-5e9b1fee-e54e-4121-bd96-b50cbcd8ca6e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:46.822126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-5e9b1fee-e54e-4121-bd96-b50cbcd8ca6e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.169127 May 09 23:05:46.822726 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 200/391] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:46 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:47.846029 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-929472fd-415a-4000-a12c-4d070d65b2ea tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:47.846703 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-929472fd-415a-4000-a12c-4d070d65b2ea tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:47.853355 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-929472fd-415a-4000-a12c-4d070d65b2ea tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:47.853807 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-929472fd-415a-4000-a12c-4d070d65b2ea tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:47.854839 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-929472fd-415a-4000-a12c-4d070d65b2ea tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:47.855471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-929472fd-415a-4000-a12c-4d070d65b2ea tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:47.994461 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-929472fd-415a-4000-a12c-4d070d65b2ea tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:48.003659 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-929472fd-415a-4000-a12c-4d070d65b2ea tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:48.005178 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-929472fd-415a-4000-a12c-4d070d65b2ea tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:48.006376 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-929472fd-415a-4000-a12c-4d070d65b2ea tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.164237 May 09 23:05:48.007162 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 192/392] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:47 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:49.024504 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-9b7f3c67-eec4-4827-b404-f5341c4d7f5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:49.025110 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-9b7f3c67-eec4-4827-b404-f5341c4d7f5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:49.031591 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9b7f3c67-eec4-4827-b404-f5341c4d7f5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:49.032025 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9b7f3c67-eec4-4827-b404-f5341c4d7f5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:49.032807 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9b7f3c67-eec4-4827-b404-f5341c4d7f5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:49.033241 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9b7f3c67-eec4-4827-b404-f5341c4d7f5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:49.182267 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-9b7f3c67-eec4-4827-b404-f5341c4d7f5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:49.192215 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-9b7f3c67-eec4-4827-b404-f5341c4d7f5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:49.194066 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-9b7f3c67-eec4-4827-b404-f5341c4d7f5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:49.195420 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-9b7f3c67-eec4-4827-b404-f5341c4d7f5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.174798 May 09 23:05:49.196206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 201/393] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:49 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:50.214507 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-2992f595-1c59-40f0-a4b3-d035a74da2bb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:50.215224 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-2992f595-1c59-40f0-a4b3-d035a74da2bb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:50.223367 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2992f595-1c59-40f0-a4b3-d035a74da2bb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:50.224188 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2992f595-1c59-40f0-a4b3-d035a74da2bb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:50.225555 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2992f595-1c59-40f0-a4b3-d035a74da2bb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:50.226006 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2992f595-1c59-40f0-a4b3-d035a74da2bb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:50.366092 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-2992f595-1c59-40f0-a4b3-d035a74da2bb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:50.374503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-2992f595-1c59-40f0-a4b3-d035a74da2bb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:50.376561 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-2992f595-1c59-40f0-a4b3-d035a74da2bb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:50.377733 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-2992f595-1c59-40f0-a4b3-d035a74da2bb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.167343 May 09 23:05:50.378546 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 193/394] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:50 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:51.397058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-93d3f795-cc07-4a1a-bba4-631e2dd6d039 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:51.397725 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-93d3f795-cc07-4a1a-bba4-631e2dd6d039 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:51.403708 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-93d3f795-cc07-4a1a-bba4-631e2dd6d039 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:51.404418 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-93d3f795-cc07-4a1a-bba4-631e2dd6d039 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:51.405393 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-93d3f795-cc07-4a1a-bba4-631e2dd6d039 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:51.406022 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-93d3f795-cc07-4a1a-bba4-631e2dd6d039 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:51.540123 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-93d3f795-cc07-4a1a-bba4-631e2dd6d039 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:51.550000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-93d3f795-cc07-4a1a-bba4-631e2dd6d039 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:51.551578 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-93d3f795-cc07-4a1a-bba4-631e2dd6d039 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:51.552749 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-93d3f795-cc07-4a1a-bba4-631e2dd6d039 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.160246 May 09 23:05:51.553470 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 202/395] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:51 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:52.571715 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a376397e-fa03-4179-8c39-243feb80d77f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:52.572406 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a376397e-fa03-4179-8c39-243feb80d77f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:52.578726 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a376397e-fa03-4179-8c39-243feb80d77f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:52.579190 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a376397e-fa03-4179-8c39-243feb80d77f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:52.579967 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a376397e-fa03-4179-8c39-243feb80d77f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:52.580411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a376397e-fa03-4179-8c39-243feb80d77f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:52.707579 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a376397e-fa03-4179-8c39-243feb80d77f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:52.715686 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a376397e-fa03-4179-8c39-243feb80d77f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:52.717168 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a376397e-fa03-4179-8c39-243feb80d77f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:52.718338 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a376397e-fa03-4179-8c39-243feb80d77f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.150750 May 09 23:05:52.718897 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 194/396] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:52 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:53.568987 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f540e6a1-77a0-4afd-9b91-e4fbb5e71c17 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:53.569550 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f540e6a1-77a0-4afd-9b91-e4fbb5e71c17 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:53.575585 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f540e6a1-77a0-4afd-9b91-e4fbb5e71c17 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:53.576023 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f540e6a1-77a0-4afd-9b91-e4fbb5e71c17 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:53.576846 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f540e6a1-77a0-4afd-9b91-e4fbb5e71c17 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:53.577292 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f540e6a1-77a0-4afd-9b91-e4fbb5e71c17 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:53.599867 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f540e6a1-77a0-4afd-9b91-e4fbb5e71c17 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841/ips" status: 200 len: 150 microversion: 2.1 time: 0.034768 May 09 23:05:53.600454 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 203/397] 10.222.0.23 () {58 vars in 1247 bytes} [Mon May 9 23:05:53 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:05:53.611992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f001a1ff-dca0-4b78-a221-c2d2bebf53b3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be04a6c4-9386-49f4-8c57-c37ff92dce7f"}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:05:53.613110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f001a1ff-dca0-4b78-a221-c2d2bebf53b3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:53.619432 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f001a1ff-dca0-4b78-a221-c2d2bebf53b3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:53.619882 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f001a1ff-dca0-4b78-a221-c2d2bebf53b3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:53.620644 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f001a1ff-dca0-4b78-a221-c2d2bebf53b3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:53.621083 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f001a1ff-dca0-4b78-a221-c2d2bebf53b3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:53.699132 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-f001a1ff-dca0-4b78-a221-c2d2bebf53b3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] HTTP exception thrown: Invalid volume: volume be04a6c4-9386-49f4-8c57-c37ff92dce7f is already attached to instances: da290c35-0f36-4420-aaf8-d18fd9b906f0 May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f001a1ff-dca0-4b78-a221-c2d2bebf53b3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Request method failure captured: May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: POST /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841/os-volume_attachments HTTP/1.1 May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 74 May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ2AZq5EfNRX4A2tCiVwicbnfgrKkrL1gKGZ2i9kDkpeQEVnPD6CHxNPMLHcnk-nNrqb42O05Dml9fFcVJ8tZC-e8-FzgQMzIs0cjdHVhCDJH8lgSgXK8gUI8fFy_4mLaumbFrU7L_T2O0x7fdFRFsthOIPJ0V_6K6OxmafCQoxWJqE May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:05:53.700838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:05:53.702302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b776734a879d4c0785b1d3728b79b766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:05:53.702302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:05:53.702302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:05:53.702302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:05:53.702302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:05:53.702302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:05:53.702302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:05:53.702302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 84a45506c19c4cda8173c164a097f925 May 09 23:05:53.702302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:05:53.702302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: May 09 23:05:53.702302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {"volumeAttachment": {"volumeId": "be04a6c4-9386-49f4-8c57-c37ff92dce7f"}} May 09 23:05:53.702302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Invalid volume: volume be04a6c4-9386-49f4-8c57-c37ff92dce7f is already attached to instances: da290c35-0f36-4420-aaf8-d18fd9b906f0 May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'server_id': 'a46c08db-d64b-4794-85f2-3ade7544e841', 'body': {'volumeAttachment': {'volumeId': 'be04a6c4-9386-49f4-8c57-c37ff92dce7f'}}} May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume be04a6c4-9386-49f4-8c57-c37ff92dce7f is already attached to instances: da290c35-0f36-4420-aaf8-d18fd9b906f0 May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:05:53.703073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume be04a6c4-9386-49f4-8c57-c37ff92dce7f is already attached to instances: da290c35-0f36-4420-aaf8-d18fd9b906f0 May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:05:53.705059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:05:53.706683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:05:53.706683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:05:53.706683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:05:53.706683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume be04a6c4-9386-49f4-8c57-c37ff92dce7f is already attached to instances: da290c35-0f36-4420-aaf8-d18fd9b906f0 May 09 23:05:53.706683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:05:53.706683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f001a1ff-dca0-4b78-a221-c2d2bebf53b3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Returning 400 to user: Invalid volume: volume be04a6c4-9386-49f4-8c57-c37ff92dce7f is already attached to instances: da290c35-0f36-4420-aaf8-d18fd9b906f0 {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:05:53.706683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f001a1ff-dca0-4b78-a221-c2d2bebf53b3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "POST /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094949 May 09 23:05:53.706683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 195/398] 10.222.0.23 () {60 vars in 1322 bytes} [Mon May 9 23:05:53 2022] POST /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 23:05:53.711655 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-fde04c11-60ea-4cf9-bcd7-559f04af0895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:53.712173 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-fde04c11-60ea-4cf9-bcd7-559f04af0895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:53.717972 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fde04c11-60ea-4cf9-bcd7-559f04af0895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:53.718446 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fde04c11-60ea-4cf9-bcd7-559f04af0895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:53.719196 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fde04c11-60ea-4cf9-bcd7-559f04af0895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:53.720269 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fde04c11-60ea-4cf9-bcd7-559f04af0895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:53.737065 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-46cbf6e7-3575-4319-89b3-eeabacb71bd0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:53.737683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-46cbf6e7-3575-4319-89b3-eeabacb71bd0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:53.744297 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-46cbf6e7-3575-4319-89b3-eeabacb71bd0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:53.744561 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-fde04c11-60ea-4cf9-bcd7-559f04af0895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Going to try to terminate instance {{(pid=117143) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:05:53.744748 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-46cbf6e7-3575-4319-89b3-eeabacb71bd0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:53.745519 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-46cbf6e7-3575-4319-89b3-eeabacb71bd0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:53.745960 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-46cbf6e7-3575-4319-89b3-eeabacb71bd0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:53.821896 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-fde04c11-60ea-4cf9-bcd7-559f04af0895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 204 len: 0 microversion: 2.1 time: 0.113447 May 09 23:05:53.823039 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 204/399] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:05:53 2022] DELETE /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 23:05:53.833079 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e836036a-e30b-4154-95bb-16c1575419f8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:53.833958 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e836036a-e30b-4154-95bb-16c1575419f8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:53.840789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e836036a-e30b-4154-95bb-16c1575419f8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:53.841239 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e836036a-e30b-4154-95bb-16c1575419f8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:53.842004 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e836036a-e30b-4154-95bb-16c1575419f8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:53.842875 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e836036a-e30b-4154-95bb-16c1575419f8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:53.880827 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-46cbf6e7-3575-4319-89b3-eeabacb71bd0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:53.889405 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-46cbf6e7-3575-4319-89b3-eeabacb71bd0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:53.890943 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-46cbf6e7-3575-4319-89b3-eeabacb71bd0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:53.892749 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-46cbf6e7-3575-4319-89b3-eeabacb71bd0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.159500 May 09 23:05:53.893176 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 196/400] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:53 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:05:53.974997 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e836036a-e30b-4154-95bb-16c1575419f8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:53.982503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e836036a-e30b-4154-95bb-16c1575419f8 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1681 microversion: 2.1 time: 0.155058 May 09 23:05:53.983074 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 205/401] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:53 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:05:54.795445 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-76604f78-f71b-425e-99ac-00ccc26dc0cf tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6afe6aa-2659-4976-80d6-142dc63f88b0"}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:05:54.796515 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-76604f78-f71b-425e-99ac-00ccc26dc0cf tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:54.802844 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-76604f78-f71b-425e-99ac-00ccc26dc0cf tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:54.803300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-76604f78-f71b-425e-99ac-00ccc26dc0cf tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:54.804078 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-76604f78-f71b-425e-99ac-00ccc26dc0cf tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:54.804524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-76604f78-f71b-425e-99ac-00ccc26dc0cf tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:54.912979 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b83d4e87-97bf-4f8d-a7a3-f92bc2141bca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:54.913801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b83d4e87-97bf-4f8d-a7a3-f92bc2141bca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:54.920242 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b83d4e87-97bf-4f8d-a7a3-f92bc2141bca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:54.920697 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b83d4e87-97bf-4f8d-a7a3-f92bc2141bca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:54.921472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b83d4e87-97bf-4f8d-a7a3-f92bc2141bca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:54.921906 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b83d4e87-97bf-4f8d-a7a3-f92bc2141bca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:55.047757 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b83d4e87-97bf-4f8d-a7a3-f92bc2141bca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:55.055907 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b83d4e87-97bf-4f8d-a7a3-f92bc2141bca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:55.057403 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b83d4e87-97bf-4f8d-a7a3-f92bc2141bca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:55.058583 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b83d4e87-97bf-4f8d-a7a3-f92bc2141bca tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.150824 May 09 23:05:55.059148 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 206/402] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:54 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:05:55.064015 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a96081c9-b465-4fe4-956f-e256a8c22923 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:55.064612 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a96081c9-b465-4fe4-956f-e256a8c22923 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:55.069986 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a96081c9-b465-4fe4-956f-e256a8c22923 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:55.070469 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a96081c9-b465-4fe4-956f-e256a8c22923 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:55.071241 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a96081c9-b465-4fe4-956f-e256a8c22923 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:55.071674 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a96081c9-b465-4fe4-956f-e256a8c22923 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:55.196335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a96081c9-b465-4fe4-956f-e256a8c22923 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:55.203534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a96081c9-b465-4fe4-956f-e256a8c22923 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1681 microversion: 2.1 time: 0.143424 May 09 23:05:55.204761 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 207/403] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:55 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1681 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:05:55.373212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-76604f78-f71b-425e-99ac-00ccc26dc0cf tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "POST /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.581720 May 09 23:05:55.373820 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 197/404] 10.222.0.23 () {60 vars in 1322 bytes} [Mon May 9 23:05:54 2022] POST /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-volume_attachments => generated 194 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:05:55.496158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e08b9960-88ca-47bb-9d14-ae196dbb9fbd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:55.496657 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e08b9960-88ca-47bb-9d14-ae196dbb9fbd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:55.503165 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e08b9960-88ca-47bb-9d14-ae196dbb9fbd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:55.503610 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e08b9960-88ca-47bb-9d14-ae196dbb9fbd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:55.504481 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e08b9960-88ca-47bb-9d14-ae196dbb9fbd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:55.504849 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e08b9960-88ca-47bb-9d14-ae196dbb9fbd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:55.630099 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.objects.instance [None req-e08b9960-88ca-47bb-9d14-ae196dbb9fbd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lazy-loading 'services' on Instance uuid 1e5e8a34-6fc9-49eb-a769-63373d0dc44c {{(pid=117143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:05:55.746149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e08b9960-88ca-47bb-9d14-ae196dbb9fbd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c/os-volume_attachments/06357bc0-afd0-49a5-b26c-88912f02995c" status: 202 len: 0 microversion: 2.1 time: 0.253651 May 09 23:05:55.746940 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 208/405] 10.222.0.23 () {58 vars in 1415 bytes} [Mon May 9 23:05:55 2022] DELETE /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c/os-volume_attachments/06357bc0-afd0-49a5-b26c-88912f02995c => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:05:56.077830 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-50215a70-359b-4ff5-9340-c31c2e97e10a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:56.079120 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-50215a70-359b-4ff5-9340-c31c2e97e10a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:56.085291 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-50215a70-359b-4ff5-9340-c31c2e97e10a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:56.085808 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-50215a70-359b-4ff5-9340-c31c2e97e10a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:56.086635 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-50215a70-359b-4ff5-9340-c31c2e97e10a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:56.087070 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-50215a70-359b-4ff5-9340-c31c2e97e10a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:56.223068 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7a27199e-a008-4100-a5de-c616fefe280c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:56.223595 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7a27199e-a008-4100-a5de-c616fefe280c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:56.230746 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7a27199e-a008-4100-a5de-c616fefe280c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:56.231355 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7a27199e-a008-4100-a5de-c616fefe280c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:56.232658 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7a27199e-a008-4100-a5de-c616fefe280c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:56.233443 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7a27199e-a008-4100-a5de-c616fefe280c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:56.306750 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7a27199e-a008-4100-a5de-c616fefe280c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:56.310260 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-50215a70-359b-4ff5-9340-c31c2e97e10a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:56.315116 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7a27199e-a008-4100-a5de-c616fefe280c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 200 len: 1614 microversion: 2.1 time: 0.097432 May 09 23:05:56.315946 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 209/406] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:56 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 1614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:05:56.320707 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-50215a70-359b-4ff5-9340-c31c2e97e10a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:56.324159 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-50215a70-359b-4ff5-9340-c31c2e97e10a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:56.325429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-50215a70-359b-4ff5-9340-c31c2e97e10a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.252315 May 09 23:05:56.325990 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 198/407] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:56 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:56.546442 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-62dd478a-f463-4320-8d13-9ac7a01c78c4 req-25a62745-d853-476e-9193-37ebc08b0a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46c08db-d64b-4794-85f2-3ade7544e841", "name": "network-vif-deleted", "tag": "dd84391b-cd8f-4c04-9bb7-f12890f8e469"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:05:56.554935 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-62dd478a-f463-4320-8d13-9ac7a01c78c4 req-25a62745-d853-476e-9193-37ebc08b0a73 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:56.555387 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-62dd478a-f463-4320-8d13-9ac7a01c78c4 req-25a62745-d853-476e-9193-37ebc08b0a73 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:56.570623 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-62dd478a-f463-4320-8d13-9ac7a01c78c4 req-25a62745-d853-476e-9193-37ebc08b0a73 service nova] Creating event network-vif-deleted:dd84391b-cd8f-4c04-9bb7-f12890f8e469 for instance a46c08db-d64b-4794-85f2-3ade7544e841 on hv-cinder-84067 May 09 23:05:56.575529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-62dd478a-f463-4320-8d13-9ac7a01c78c4 req-25a62745-d853-476e-9193-37ebc08b0a73 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032671 May 09 23:05:56.576258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 210/408] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:05:57.333300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1907b425-5731-4ec5-bd5a-12d71a8d8e48 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:57.333941 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1907b425-5731-4ec5-bd5a-12d71a8d8e48 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:57.346201 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-99f69387-2747-4aa8-b19c-2b5497ce87a5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:57.346900 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-99f69387-2747-4aa8-b19c-2b5497ce87a5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:57.355911 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1907b425-5731-4ec5-bd5a-12d71a8d8e48 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:57.356368 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1907b425-5731-4ec5-bd5a-12d71a8d8e48 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:57.357423 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1907b425-5731-4ec5-bd5a-12d71a8d8e48 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:57.357856 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1907b425-5731-4ec5-bd5a-12d71a8d8e48 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:57.363381 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-99f69387-2747-4aa8-b19c-2b5497ce87a5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:57.363836 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-99f69387-2747-4aa8-b19c-2b5497ce87a5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:57.364628 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-99f69387-2747-4aa8-b19c-2b5497ce87a5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:57.365403 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-99f69387-2747-4aa8-b19c-2b5497ce87a5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:57.397252 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-1907b425-5731-4ec5-bd5a-12d71a8d8e48 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] HTTP exception thrown: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1907b425-5731-4ec5-bd5a-12d71a8d8e48 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Request method failure captured: May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 HTTP/1.1 May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ2AZq5EfNRX4A2tCiVwicbnfgrKkrL1gKGZ2i9kDkpeQEVnPD6CHxNPMLHcnk-nNrqb42O05Dml9fFcVJ8tZC-e8-FzgQMzIs0cjdHVhCDJH8lgSgXK8gUI8fFy_4mLaumbFrU7L_T2O0x7fdFRFsthOIPJ0V_6K6OxmafCQoxWJqE May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:05:57.399200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:05:57.400592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b776734a879d4c0785b1d3728b79b766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:05:57.400592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:05:57.400592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:05:57.400592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:05:57.400592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:05:57.400592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:05:57.400592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:05:57.400592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 84a45506c19c4cda8173c164a097f925 May 09 23:05:57.400592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:05:57.400592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:05:57.400592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:05:57.400592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': 'a46c08db-d64b-4794-85f2-3ade7544e841'} May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:05:57.401307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:05:57.402701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:05:57.405132 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1907b425-5731-4ec5-bd5a-12d71a8d8e48 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Returning 404 to user: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:05:57.405993 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1907b425-5731-4ec5-bd5a-12d71a8d8e48 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 404 len: 111 microversion: 2.1 time: 0.077423 May 09 23:05:57.406592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 199/409] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:05:57 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:05:57.415143 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-57d6ae2d-4388-4e2a-b1dd-fcbd75fd49b5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '.version_select at 0x7fc28bc05280>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:57.436306 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-57d6ae2d-4388-4e2a-b1dd-fcbd75fd49b5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994992470" status: 202 len: 0 microversion: 2.1 time: 0.024705 May 09 23:05:57.437105 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 200/410] 10.222.0.23 () {58 vars in 1217 bytes} [Mon May 9 23:05:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994992470 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 23:05:57.523128 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-99f69387-2747-4aa8-b19c-2b5497ce87a5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:57.539667 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-99f69387-2747-4aa8-b19c-2b5497ce87a5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:57.541951 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-99f69387-2747-4aa8-b19c-2b5497ce87a5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:57.543406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-99f69387-2747-4aa8-b19c-2b5497ce87a5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.202888 May 09 23:05:57.544278 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 211/411] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:57 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:58.407186 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d75cf85a-cf5b-4d30-a6ae-403a39ea9138 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:58.407775 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-d75cf85a-cf5b-4d30-a6ae-403a39ea9138 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:58.414866 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d75cf85a-cf5b-4d30-a6ae-403a39ea9138 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:58.415327 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d75cf85a-cf5b-4d30-a6ae-403a39ea9138 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:58.416100 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d75cf85a-cf5b-4d30-a6ae-403a39ea9138 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:58.416544 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d75cf85a-cf5b-4d30-a6ae-403a39ea9138 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:58.541414 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-d75cf85a-cf5b-4d30-a6ae-403a39ea9138 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lazy-loading 'services' on Instance uuid da290c35-0f36-4420-aaf8-d18fd9b906f0 {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:05:58.562506 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-204e382e-b7df-4f95-8573-170201166d49 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:58.563767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-204e382e-b7df-4f95-8573-170201166d49 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:58.570458 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-204e382e-b7df-4f95-8573-170201166d49 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:58.570907 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-204e382e-b7df-4f95-8573-170201166d49 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:58.571684 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-204e382e-b7df-4f95-8573-170201166d49 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:58.572133 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-204e382e-b7df-4f95-8573-170201166d49 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:58.673458 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d75cf85a-cf5b-4d30-a6ae-403a39ea9138 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments/be04a6c4-9386-49f4-8c57-c37ff92dce7f" status: 202 len: 0 microversion: 2.1 time: 0.270025 May 09 23:05:58.674070 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 201/412] 10.222.0.23 () {58 vars in 1415 bytes} [Mon May 9 23:05:58 2022] DELETE /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments/be04a6c4-9386-49f4-8c57-c37ff92dce7f => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:05:58.683224 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-7911492f-e2e3-493f-82a9-0726810e607c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:58.684508 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-7911492f-e2e3-493f-82a9-0726810e607c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:58.691965 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7911492f-e2e3-493f-82a9-0726810e607c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:58.692421 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7911492f-e2e3-493f-82a9-0726810e607c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:58.693219 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7911492f-e2e3-493f-82a9-0726810e607c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:58.693661 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7911492f-e2e3-493f-82a9-0726810e607c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:58.735209 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-204e382e-b7df-4f95-8573-170201166d49 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:58.736735 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-7911492f-e2e3-493f-82a9-0726810e607c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057897 May 09 23:05:58.738407 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 202/413] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:05:58 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:05:58.745612 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-204e382e-b7df-4f95-8573-170201166d49 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:58.747150 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-204e382e-b7df-4f95-8573-170201166d49 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:58.748336 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-204e382e-b7df-4f95-8573-170201166d49 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.189899 May 09 23:05:58.748905 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 212/414] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:58 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:05:59.747772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a82d3524-eddb-4f93-a120-78017321d52c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:59.748602 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a82d3524-eddb-4f93-a120-78017321d52c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:59.754837 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a82d3524-eddb-4f93-a120-78017321d52c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:59.755291 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a82d3524-eddb-4f93-a120-78017321d52c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:59.756068 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a82d3524-eddb-4f93-a120-78017321d52c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:59.756510 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a82d3524-eddb-4f93-a120-78017321d52c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:59.767419 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-07d26d96-8787-4027-afaf-a246890d6b5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:05:59.768029 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-07d26d96-8787-4027-afaf-a246890d6b5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:05:59.774203 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-07d26d96-8787-4027-afaf-a246890d6b5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:59.774647 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-07d26d96-8787-4027-afaf-a246890d6b5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:59.775410 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-07d26d96-8787-4027-afaf-a246890d6b5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:05:59.775845 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-07d26d96-8787-4027-afaf-a246890d6b5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:05:59.786430 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a82d3524-eddb-4f93-a120-78017321d52c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042567 May 09 23:05:59.787011 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 203/415] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:05:59 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:05:59.904843 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-07d26d96-8787-4027-afaf-a246890d6b5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:59.913496 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-07d26d96-8787-4027-afaf-a246890d6b5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:59.915009 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-07d26d96-8787-4027-afaf-a246890d6b5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:05:59.916149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-07d26d96-8787-4027-afaf-a246890d6b5f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.153041 May 09 23:05:59.916710 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 213/416] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:05:59 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:06:00.798408 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1e243785-962c-4875-b640-c376303c5d74 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:00.799334 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1e243785-962c-4875-b640-c376303c5d74 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:00.805643 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1e243785-962c-4875-b640-c376303c5d74 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:00.806090 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1e243785-962c-4875-b640-c376303c5d74 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:00.806897 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1e243785-962c-4875-b640-c376303c5d74 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:00.807328 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1e243785-962c-4875-b640-c376303c5d74 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:00.836212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1e243785-962c-4875-b640-c376303c5d74 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042252 May 09 23:06:00.836770 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 204/417] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:06:00 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:06:00.934618 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5ccb98d2-b1de-4e4b-9cd6-d87261589438 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:00.935151 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-5ccb98d2-b1de-4e4b-9cd6-d87261589438 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:00.941434 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5ccb98d2-b1de-4e4b-9cd6-d87261589438 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:00.941888 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5ccb98d2-b1de-4e4b-9cd6-d87261589438 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:00.942691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5ccb98d2-b1de-4e4b-9cd6-d87261589438 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:00.943125 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5ccb98d2-b1de-4e4b-9cd6-d87261589438 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:01.069612 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-5ccb98d2-b1de-4e4b-9cd6-d87261589438 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:01.077807 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-5ccb98d2-b1de-4e4b-9cd6-d87261589438 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:01.079323 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-5ccb98d2-b1de-4e4b-9cd6-d87261589438 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:01.080455 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-5ccb98d2-b1de-4e4b-9cd6-d87261589438 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.149826 May 09 23:06:01.081001 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 214/418] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:06:00 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:06:01.848230 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9a168d27-6098-4338-9bb2-72f7b5ef3e66 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:01.849144 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9a168d27-6098-4338-9bb2-72f7b5ef3e66 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:01.855313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9a168d27-6098-4338-9bb2-72f7b5ef3e66 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:01.855707 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9a168d27-6098-4338-9bb2-72f7b5ef3e66 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:01.856467 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9a168d27-6098-4338-9bb2-72f7b5ef3e66 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:01.858370 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9a168d27-6098-4338-9bb2-72f7b5ef3e66 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:01.887501 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9a168d27-6098-4338-9bb2-72f7b5ef3e66 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043594 May 09 23:06:01.888150 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 205/419] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:06:01 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:06:02.098146 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6c5842a1-fa67-4d0b-9dbb-ec8d89b9b8c6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:02.099339 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6c5842a1-fa67-4d0b-9dbb-ec8d89b9b8c6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:02.105652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6c5842a1-fa67-4d0b-9dbb-ec8d89b9b8c6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:02.106090 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6c5842a1-fa67-4d0b-9dbb-ec8d89b9b8c6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:02.107169 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6c5842a1-fa67-4d0b-9dbb-ec8d89b9b8c6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:02.107609 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6c5842a1-fa67-4d0b-9dbb-ec8d89b9b8c6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:02.238426 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6c5842a1-fa67-4d0b-9dbb-ec8d89b9b8c6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:02.251685 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6c5842a1-fa67-4d0b-9dbb-ec8d89b9b8c6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:02.253360 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6c5842a1-fa67-4d0b-9dbb-ec8d89b9b8c6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:02.254543 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6c5842a1-fa67-4d0b-9dbb-ec8d89b9b8c6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.160304 May 09 23:06:02.255299 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 215/420] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:06:02 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:06:02.868913 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a30dc9ad-4cb6-458e-86b2-af36dfee1a10 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:02.869844 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a30dc9ad-4cb6-458e-86b2-af36dfee1a10 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:02.876637 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a30dc9ad-4cb6-458e-86b2-af36dfee1a10 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:02.877079 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a30dc9ad-4cb6-458e-86b2-af36dfee1a10 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:02.877833 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a30dc9ad-4cb6-458e-86b2-af36dfee1a10 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:02.878308 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a30dc9ad-4cb6-458e-86b2-af36dfee1a10 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:02.898218 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ca2f8b70-f0b7-4e8a-bef6-dccb6a8af29d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:02.899145 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ca2f8b70-f0b7-4e8a-bef6-dccb6a8af29d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:02.899753 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-a30dc9ad-4cb6-458e-86b2-af36dfee1a10 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lazy-loading 'flavor' on Instance uuid bccbae96-189c-4f1a-8a18-a94e8684d9b6 {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:06:02.904901 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ca2f8b70-f0b7-4e8a-bef6-dccb6a8af29d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:02.905350 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ca2f8b70-f0b7-4e8a-bef6-dccb6a8af29d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:02.906157 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ca2f8b70-f0b7-4e8a-bef6-dccb6a8af29d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:02.906627 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ca2f8b70-f0b7-4e8a-bef6-dccb6a8af29d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:02.935235 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ca2f8b70-f0b7-4e8a-bef6-dccb6a8af29d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040875 May 09 23:06:02.935791 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 216/421] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:06:02 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:06:03.059298 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a30dc9ad-4cb6-458e-86b2-af36dfee1a10 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "POST /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/action" status: 200 len: 32 microversion: 2.1 time: 0.194049 May 09 23:06:03.059993 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 206/422] 10.222.0.23 () {60 vars in 1277 bytes} [Mon May 9 23:06:02 2022] POST /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 23:06:03.069430 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-379ff874-92c1-4aab-994b-b6b417716620 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:03.070044 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-379ff874-92c1-4aab-994b-b6b417716620 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:03.076555 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-379ff874-92c1-4aab-994b-b6b417716620 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:03.077007 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-379ff874-92c1-4aab-994b-b6b417716620 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:03.077929 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-379ff874-92c1-4aab-994b-b6b417716620 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:03.078959 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-379ff874-92c1-4aab-994b-b6b417716620 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:03.190441 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-600d9701-ec3e-4a87-ade5-63d90787b4bd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:03.191289 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-600d9701-ec3e-4a87-ade5-63d90787b4bd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:03.198459 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-600d9701-ec3e-4a87-ade5-63d90787b4bd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:03.198914 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-600d9701-ec3e-4a87-ade5-63d90787b4bd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:03.199705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-600d9701-ec3e-4a87-ade5-63d90787b4bd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:03.200145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-600d9701-ec3e-4a87-ade5-63d90787b4bd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:03.223325 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-379ff874-92c1-4aab-994b-b6b417716620 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:03.231112 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-379ff874-92c1-4aab-994b-b6b417716620 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.165439 May 09 23:06:03.238434 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-600d9701-ec3e-4a87-ade5-63d90787b4bd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Going to try to terminate instance {{(pid=117142) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:06:03.243235 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 217/423] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:03 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:03.272661 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-fdf6896b-6ba2-4fb6-b02e-71d5dba5748e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:03.273309 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-fdf6896b-6ba2-4fb6-b02e-71d5dba5748e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:03.279223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fdf6896b-6ba2-4fb6-b02e-71d5dba5748e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:03.279657 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fdf6896b-6ba2-4fb6-b02e-71d5dba5748e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:03.280433 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fdf6896b-6ba2-4fb6-b02e-71d5dba5748e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:03.280867 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fdf6896b-6ba2-4fb6-b02e-71d5dba5748e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:03.324903 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-600d9701-ec3e-4a87-ade5-63d90787b4bd tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 204 len: 0 microversion: 2.1 time: 0.137900 May 09 23:06:03.324903 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 207/424] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:06:03 2022] DELETE /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 23:06:03.333237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-3de996f3-a194-48f4-82f1-e46f1bf386c3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:03.333947 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-3de996f3-a194-48f4-82f1-e46f1bf386c3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:03.340412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3de996f3-a194-48f4-82f1-e46f1bf386c3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:03.340969 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3de996f3-a194-48f4-82f1-e46f1bf386c3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:03.342280 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3de996f3-a194-48f4-82f1-e46f1bf386c3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:03.342839 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3de996f3-a194-48f4-82f1-e46f1bf386c3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:03.422859 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-fdf6896b-6ba2-4fb6-b02e-71d5dba5748e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:03.431012 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-fdf6896b-6ba2-4fb6-b02e-71d5dba5748e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:03.432509 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-fdf6896b-6ba2-4fb6-b02e-71d5dba5748e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:03.433643 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-fdf6896b-6ba2-4fb6-b02e-71d5dba5748e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.164884 May 09 23:06:03.434218 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 218/425] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:06:03 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:06:03.482711 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-3de996f3-a194-48f4-82f1-e46f1bf386c3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:03.490927 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-3de996f3-a194-48f4-82f1-e46f1bf386c3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1515 microversion: 2.1 time: 0.161803 May 09 23:06:03.491506 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 208/426] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:03 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:03.756378 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-4c0d4e37-3a35-465a-be68-68bfdc64d4ff req-6d7f6ac5-f224-41b3-a49d-66468d7b63f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5734d5-da65-4ee8-8684-e236f56da50a", "name": "network-vif-plugged", "status": "completed", "tag": "9b2aff87-eeca-44a4-b616-becbcd5f1d58"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:03.764123 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-4c0d4e37-3a35-465a-be68-68bfdc64d4ff req-6d7f6ac5-f224-41b3-a49d-66468d7b63f3 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:03.764561 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-4c0d4e37-3a35-465a-be68-68bfdc64d4ff req-6d7f6ac5-f224-41b3-a49d-66468d7b63f3 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:03.776269 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-4c0d4e37-3a35-465a-be68-68bfdc64d4ff req-6d7f6ac5-f224-41b3-a49d-66468d7b63f3 service nova] Creating event network-vif-plugged:9b2aff87-eeca-44a4-b616-becbcd5f1d58 for instance 2e5734d5-da65-4ee8-8684-e236f56da50a on hv-cinder-84067 May 09 23:06:03.781133 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-4c0d4e37-3a35-465a-be68-68bfdc64d4ff req-6d7f6ac5-f224-41b3-a49d-66468d7b63f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028402 May 09 23:06:03.782518 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 219/427] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:06:03.947503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-da5e78f1-f731-4367-96c4-7b2ad1a05e6f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:03.948411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-da5e78f1-f731-4367-96c4-7b2ad1a05e6f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:03.955463 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-da5e78f1-f731-4367-96c4-7b2ad1a05e6f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:03.955947 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-da5e78f1-f731-4367-96c4-7b2ad1a05e6f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:03.956746 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-da5e78f1-f731-4367-96c4-7b2ad1a05e6f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:03.957183 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-da5e78f1-f731-4367-96c4-7b2ad1a05e6f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:03.986147 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-da5e78f1-f731-4367-96c4-7b2ad1a05e6f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042668 May 09 23:06:03.986735 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 209/428] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:06:03 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:06:04.251881 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-608f3adb-466f-477c-94d0-581adddf217c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:04.252504 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-608f3adb-466f-477c-94d0-581adddf217c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:04.258569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-608f3adb-466f-477c-94d0-581adddf217c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:04.259017 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-608f3adb-466f-477c-94d0-581adddf217c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:04.259806 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-608f3adb-466f-477c-94d0-581adddf217c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:04.260237 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-608f3adb-466f-477c-94d0-581adddf217c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:04.452022 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-139912b7-bd50-47db-b852-e317d5586662 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:04.452658 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-139912b7-bd50-47db-b852-e317d5586662 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:04.459433 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-139912b7-bd50-47db-b852-e317d5586662 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:04.459887 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-139912b7-bd50-47db-b852-e317d5586662 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:04.460681 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-139912b7-bd50-47db-b852-e317d5586662 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:04.461120 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-139912b7-bd50-47db-b852-e317d5586662 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:04.594766 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-139912b7-bd50-47db-b852-e317d5586662 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:04.598427 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-608f3adb-466f-477c-94d0-581adddf217c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:04.603006 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-139912b7-bd50-47db-b852-e317d5586662 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:04.604494 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-139912b7-bd50-47db-b852-e317d5586662 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:04.605643 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-139912b7-bd50-47db-b852-e317d5586662 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.157655 May 09 23:06:04.606216 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 210/429] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:06:04 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:06:04.606389 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-608f3adb-466f-477c-94d0-581adddf217c tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.359814 May 09 23:06:04.607388 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 220/430] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:04 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:04.611032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-4cd02a77-700d-4655-83f8-b594666d8faa tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:04.611632 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-4cd02a77-700d-4655-83f8-b594666d8faa tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:04.617352 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4cd02a77-700d-4655-83f8-b594666d8faa tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:04.617794 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4cd02a77-700d-4655-83f8-b594666d8faa tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:04.618580 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4cd02a77-700d-4655-83f8-b594666d8faa tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:04.619020 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4cd02a77-700d-4655-83f8-b594666d8faa tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:04.745198 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-4cd02a77-700d-4655-83f8-b594666d8faa tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:04.752924 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-4cd02a77-700d-4655-83f8-b594666d8faa tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1515 microversion: 2.1 time: 0.145497 May 09 23:06:04.753491 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 211/431] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:04 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1515 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:04.997486 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ad131a98-e10b-4727-b832-0c1ee4358637 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:04.998429 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ad131a98-e10b-4727-b832-0c1ee4358637 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:05.004306 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad131a98-e10b-4727-b832-0c1ee4358637 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.004751 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad131a98-e10b-4727-b832-0c1ee4358637 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.005513 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad131a98-e10b-4727-b832-0c1ee4358637 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.005941 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad131a98-e10b-4727-b832-0c1ee4358637 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.033754 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ad131a98-e10b-4727-b832-0c1ee4358637 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040514 May 09 23:06:05.034317 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 221/432] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:06:04 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 23:06:05.089185 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1a7910fa-f7bb-42bb-ae9d-ff7616ed2401 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:05.089652 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1a7910fa-f7bb-42bb-ae9d-ff7616ed2401 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:05.096418 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1a7910fa-f7bb-42bb-ae9d-ff7616ed2401 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.096861 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1a7910fa-f7bb-42bb-ae9d-ff7616ed2401 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.097616 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1a7910fa-f7bb-42bb-ae9d-ff7616ed2401 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.098041 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1a7910fa-f7bb-42bb-ae9d-ff7616ed2401 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.121704 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1a7910fa-f7bb-42bb-ae9d-ff7616ed2401 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Going to try to terminate instance {{(pid=117142) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:06:05.193183 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1a7910fa-f7bb-42bb-ae9d-ff7616ed2401 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 204 len: 0 microversion: 2.1 time: 0.107582 May 09 23:06:05.193767 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 212/433] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:06:05 2022] DELETE /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:06:05.201786 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-8182631c-dba8-4f72-b3a7-67dab2f09664 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:05.202429 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-8182631c-dba8-4f72-b3a7-67dab2f09664 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:05.208685 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8182631c-dba8-4f72-b3a7-67dab2f09664 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.209134 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8182631c-dba8-4f72-b3a7-67dab2f09664 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.209893 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8182631c-dba8-4f72-b3a7-67dab2f09664 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.210356 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8182631c-dba8-4f72-b3a7-67dab2f09664 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.344827 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-8182631c-dba8-4f72-b3a7-67dab2f09664 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:05.352152 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-8182631c-dba8-4f72-b3a7-67dab2f09664 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1682 microversion: 2.1 time: 0.154158 May 09 23:06:05.352747 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 222/434] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:05 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:05.624710 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-63bbd4e1-9885-4109-9866-7c44f888d98c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:05.625936 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-63bbd4e1-9885-4109-9866-7c44f888d98c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:05.626811 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7bd37d48-57dc-400a-8cb8-9e5f76f2a157 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:05.627488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7bd37d48-57dc-400a-8cb8-9e5f76f2a157 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:05.632461 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-63bbd4e1-9885-4109-9866-7c44f888d98c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.632950 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-63bbd4e1-9885-4109-9866-7c44f888d98c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.633737 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-63bbd4e1-9885-4109-9866-7c44f888d98c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.638007 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-63bbd4e1-9885-4109-9866-7c44f888d98c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.638161 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7bd37d48-57dc-400a-8cb8-9e5f76f2a157 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.638278 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7bd37d48-57dc-400a-8cb8-9e5f76f2a157 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.640602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7bd37d48-57dc-400a-8cb8-9e5f76f2a157 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.640602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7bd37d48-57dc-400a-8cb8-9e5f76f2a157 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.766972 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-63bbd4e1-9885-4109-9866-7c44f888d98c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:05.770147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7bd37d48-57dc-400a-8cb8-9e5f76f2a157 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:05.775729 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-63bbd4e1-9885-4109-9866-7c44f888d98c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:05.777333 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-63bbd4e1-9885-4109-9866-7c44f888d98c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:05.777682 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7bd37d48-57dc-400a-8cb8-9e5f76f2a157 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.155885 May 09 23:06:05.778276 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 223/435] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:05 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:05.778753 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-63bbd4e1-9885-4109-9866-7c44f888d98c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.158404 May 09 23:06:05.784905 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 213/436] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:06:05 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:06:05.785052 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6f167e9b-5073-441b-bc68-61b7c0584da2 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:05.785052 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6f167e9b-5073-441b-bc68-61b7c0584da2 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:05.785200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-7b50a929-6c1c-4b66-88e2-c8e5c889f52c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:05.785867 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-7b50a929-6c1c-4b66-88e2-c8e5c889f52c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:05.791036 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6f167e9b-5073-441b-bc68-61b7c0584da2 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.791537 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6f167e9b-5073-441b-bc68-61b7c0584da2 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.792306 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6f167e9b-5073-441b-bc68-61b7c0584da2 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.792574 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7b50a929-6c1c-4b66-88e2-c8e5c889f52c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.792785 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6f167e9b-5073-441b-bc68-61b7c0584da2 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.793146 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7b50a929-6c1c-4b66-88e2-c8e5c889f52c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.794000 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7b50a929-6c1c-4b66-88e2-c8e5c889f52c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.794529 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7b50a929-6c1c-4b66-88e2-c8e5c889f52c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.867061 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-7b50a929-6c1c-4b66-88e2-c8e5c889f52c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "POST /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/action" status: 202 len: 0 microversion: 2.1 time: 0.085983 May 09 23:06:05.870983 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 214/437] 10.222.0.23 () {60 vars in 1277 bytes} [Mon May 9 23:06:05 2022] POST /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:06:05.876840 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c3643227-2969-4811-a20e-a2b9a85af4e5 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:05.877475 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c3643227-2969-4811-a20e-a2b9a85af4e5 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:05.883668 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c3643227-2969-4811-a20e-a2b9a85af4e5 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.884115 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c3643227-2969-4811-a20e-a2b9a85af4e5 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.884887 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c3643227-2969-4811-a20e-a2b9a85af4e5 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:05.885320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c3643227-2969-4811-a20e-a2b9a85af4e5 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:05.920873 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6f167e9b-5073-441b-bc68-61b7c0584da2 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:05.928951 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6f167e9b-5073-441b-bc68-61b7c0584da2 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1515 microversion: 2.1 time: 0.149702 May 09 23:06:05.929662 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 224/438] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:05 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:06.027286 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c3643227-2969-4811-a20e-a2b9a85af4e5 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:06.034880 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c3643227-2969-4811-a20e-a2b9a85af4e5 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1751 microversion: 2.1 time: 0.162783 May 09 23:06:06.035449 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 215/439] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:05 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:06.369518 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2b2d8e87-6e9f-4fa0-ba7d-23dfd2335197 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:06.370155 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2b2d8e87-6e9f-4fa0-ba7d-23dfd2335197 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:06.376325 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2b2d8e87-6e9f-4fa0-ba7d-23dfd2335197 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:06.376773 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2b2d8e87-6e9f-4fa0-ba7d-23dfd2335197 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:06.377554 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2b2d8e87-6e9f-4fa0-ba7d-23dfd2335197 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:06.377982 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2b2d8e87-6e9f-4fa0-ba7d-23dfd2335197 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:06.504581 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2b2d8e87-6e9f-4fa0-ba7d-23dfd2335197 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:06.511783 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2b2d8e87-6e9f-4fa0-ba7d-23dfd2335197 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1682 microversion: 2.1 time: 0.146113 May 09 23:06:06.512350 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 225/440] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:06 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:06.795090 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c41b95bf-fdee-487e-93a5-169bdc457cf8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:06.795699 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c41b95bf-fdee-487e-93a5-169bdc457cf8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:06.796793 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-8f29b675-044a-4ea4-a40f-3f408597b950 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:06.797559 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-8f29b675-044a-4ea4-a40f-3f408597b950 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:06.802129 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c41b95bf-fdee-487e-93a5-169bdc457cf8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:06.802600 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c41b95bf-fdee-487e-93a5-169bdc457cf8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:06.803376 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c41b95bf-fdee-487e-93a5-169bdc457cf8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:06.803475 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8f29b675-044a-4ea4-a40f-3f408597b950 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:06.803810 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c41b95bf-fdee-487e-93a5-169bdc457cf8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:06.803921 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8f29b675-044a-4ea4-a40f-3f408597b950 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:06.804570 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8f29b675-044a-4ea4-a40f-3f408597b950 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:06.805003 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8f29b675-044a-4ea4-a40f-3f408597b950 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:06.947106 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-8f29b675-044a-4ea4-a40f-3f408597b950 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:06.956202 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-8f29b675-044a-4ea4-a40f-3f408597b950 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:06.957919 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-8f29b675-044a-4ea4-a40f-3f408597b950 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:06.959381 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-8f29b675-044a-4ea4-a40f-3f408597b950 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.166722 May 09 23:06:06.961211 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 226/441] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:06:06 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:06:06.964945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1aff5d15-d266-4c4a-aebb-c91780416e72 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:06.965555 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1aff5d15-d266-4c4a-aebb-c91780416e72 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:06.972090 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1aff5d15-d266-4c4a-aebb-c91780416e72 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:06.972537 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1aff5d15-d266-4c4a-aebb-c91780416e72 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:06.973299 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1aff5d15-d266-4c4a-aebb-c91780416e72 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:06.973727 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1aff5d15-d266-4c4a-aebb-c91780416e72 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:07.221524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1aff5d15-d266-4c4a-aebb-c91780416e72 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:07.229646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1aff5d15-d266-4c4a-aebb-c91780416e72 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1515 microversion: 2.1 time: 0.268330 May 09 23:06:07.230444 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 227/442] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:06 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1515 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:07.236926 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-02c0685b-77da-46fb-8cbe-70b3703d55a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:07.237542 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-02c0685b-77da-46fb-8cbe-70b3703d55a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:07.243309 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-02c0685b-77da-46fb-8cbe-70b3703d55a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:07.243762 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-02c0685b-77da-46fb-8cbe-70b3703d55a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:07.244629 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-02c0685b-77da-46fb-8cbe-70b3703d55a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:07.244747 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c41b95bf-fdee-487e-93a5-169bdc457cf8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:07.244973 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-02c0685b-77da-46fb-8cbe-70b3703d55a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:07.256339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c41b95bf-fdee-487e-93a5-169bdc457cf8 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.465024 May 09 23:06:07.257221 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 216/443] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:06 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:07.484626 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-02c0685b-77da-46fb-8cbe-70b3703d55a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:07.492717 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-02c0685b-77da-46fb-8cbe-70b3703d55a0 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1751 microversion: 2.1 time: 0.260837 May 09 23:06:07.493293 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 228/444] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:07 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1751 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:07.528925 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-672f1b3f-5552-4716-be93-e1cd119957df tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:07.529783 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-672f1b3f-5552-4716-be93-e1cd119957df tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:07.536294 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-672f1b3f-5552-4716-be93-e1cd119957df tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:07.536818 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-672f1b3f-5552-4716-be93-e1cd119957df tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:07.537657 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-672f1b3f-5552-4716-be93-e1cd119957df tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:07.538174 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-672f1b3f-5552-4716-be93-e1cd119957df tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:07.816237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-672f1b3f-5552-4716-be93-e1cd119957df tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:07.816834 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-ad46ccb4-f8b1-4de8-a998-b6ba058779e1 req-e87241c4-a7e1-4501-8d1c-e2f58e3997cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e5e8a34-6fc9-49eb-a769-63373d0dc44c", "name": "network-vif-deleted", "tag": "7094aec5-e92d-435e-a8e8-152cdb7a3cc2"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:07.823894 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-672f1b3f-5552-4716-be93-e1cd119957df tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1682 microversion: 2.1 time: 0.298679 May 09 23:06:07.826271 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 217/445] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:07 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1682 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:07.828007 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-ad46ccb4-f8b1-4de8-a998-b6ba058779e1 req-e87241c4-a7e1-4501-8d1c-e2f58e3997cb service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:07.828486 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-ad46ccb4-f8b1-4de8-a998-b6ba058779e1 req-e87241c4-a7e1-4501-8d1c-e2f58e3997cb service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:07.840366 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-ad46ccb4-f8b1-4de8-a998-b6ba058779e1 req-e87241c4-a7e1-4501-8d1c-e2f58e3997cb service nova] Creating event network-vif-deleted:7094aec5-e92d-435e-a8e8-152cdb7a3cc2 for instance 1e5e8a34-6fc9-49eb-a769-63373d0dc44c on hv-cinder-84067 May 09 23:06:07.846409 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-ad46ccb4-f8b1-4de8-a998-b6ba058779e1 req-e87241c4-a7e1-4501-8d1c-e2f58e3997cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035097 May 09 23:06:07.847061 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 229/446] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:06:07.978362 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-eb64cf83-d83b-4df5-ab0f-ab7fcd781ae0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:07.978887 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-eb64cf83-d83b-4df5-ab0f-ab7fcd781ae0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:07.985379 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eb64cf83-d83b-4df5-ab0f-ab7fcd781ae0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:07.985831 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eb64cf83-d83b-4df5-ab0f-ab7fcd781ae0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:07.986633 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eb64cf83-d83b-4df5-ab0f-ab7fcd781ae0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:07.987066 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eb64cf83-d83b-4df5-ab0f-ab7fcd781ae0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:08.189937 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-7d6fb3c1-492e-418d-9cb3-13892fe7be61 req-03dd1eb4-277a-40ee-afb4-653cc3729255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da290c35-0f36-4420-aaf8-d18fd9b906f0", "name": "network-vif-deleted", "tag": "83fd7780-b6ac-4de6-983c-0317e0689d5b"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:08.201460 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-eb64cf83-d83b-4df5-ab0f-ab7fcd781ae0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:08.202958 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-7d6fb3c1-492e-418d-9cb3-13892fe7be61 req-03dd1eb4-277a-40ee-afb4-653cc3729255 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:08.203777 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-7d6fb3c1-492e-418d-9cb3-13892fe7be61 req-03dd1eb4-277a-40ee-afb4-653cc3729255 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:08.212919 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-eb64cf83-d83b-4df5-ab0f-ab7fcd781ae0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:08.215197 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-eb64cf83-d83b-4df5-ab0f-ab7fcd781ae0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:08.216480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-eb64cf83-d83b-4df5-ab0f-ab7fcd781ae0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.242089 May 09 23:06:08.217037 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 218/447] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:06:07 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:06:08.218075 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-7d6fb3c1-492e-418d-9cb3-13892fe7be61 req-03dd1eb4-277a-40ee-afb4-653cc3729255 service nova] Creating event network-vif-deleted:83fd7780-b6ac-4de6-983c-0317e0689d5b for instance da290c35-0f36-4420-aaf8-d18fd9b906f0 on hv-cinder-84067 May 09 23:06:08.234022 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-7d6fb3c1-492e-418d-9cb3-13892fe7be61 req-03dd1eb4-277a-40ee-afb4-653cc3729255 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048541 May 09 23:06:08.235893 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 230/448] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:06:08.247559 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-32cd896c-3755-4211-9186-b91fdd9770d1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:08.248507 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-32cd896c-3755-4211-9186-b91fdd9770d1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:08.255653 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-32cd896c-3755-4211-9186-b91fdd9770d1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:08.256438 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-32cd896c-3755-4211-9186-b91fdd9770d1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:08.257448 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-32cd896c-3755-4211-9186-b91fdd9770d1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:08.258089 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-32cd896c-3755-4211-9186-b91fdd9770d1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:08.275980 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a2a91e05-4c85-48b3-9097-917aded96299 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:08.277125 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a2a91e05-4c85-48b3-9097-917aded96299 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:08.286152 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a2a91e05-4c85-48b3-9097-917aded96299 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:08.286975 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a2a91e05-4c85-48b3-9097-917aded96299 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:08.288020 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a2a91e05-4c85-48b3-9097-917aded96299 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:08.288657 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a2a91e05-4c85-48b3-9097-917aded96299 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:08.302836 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-32cd896c-3755-4211-9186-b91fdd9770d1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:08.303364 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-32cd896c-3755-4211-9186-b91fdd9770d1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:08.303823 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-32cd896c-3755-4211-9186-b91fdd9770d1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lazy-loading 'fault' on Instance uuid 1e5e8a34-6fc9-49eb-a769-63373d0dc44c {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:06:08.354256 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-32cd896c-3755-4211-9186-b91fdd9770d1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:08.362853 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-32cd896c-3755-4211-9186-b91fdd9770d1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 200 len: 1309 microversion: 2.1 time: 0.118938 May 09 23:06:08.372085 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 219/449] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:08 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:08.428493 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a2a91e05-4c85-48b3-9097-917aded96299 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:08.436653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a2a91e05-4c85-48b3-9097-917aded96299 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.166616 May 09 23:06:08.437239 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 231/450] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:08 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:08.509818 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-3334ecdd-82cd-4898-b1b6-124969eb1fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:08.510362 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-3334ecdd-82cd-4898-b1b6-124969eb1fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:08.516638 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3334ecdd-82cd-4898-b1b6-124969eb1fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:08.517093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3334ecdd-82cd-4898-b1b6-124969eb1fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:08.517866 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3334ecdd-82cd-4898-b1b6-124969eb1fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:08.518348 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3334ecdd-82cd-4898-b1b6-124969eb1fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:08.757622 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-3334ecdd-82cd-4898-b1b6-124969eb1fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:08.765424 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-3334ecdd-82cd-4898-b1b6-124969eb1fe6 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1751 microversion: 2.1 time: 0.259595 May 09 23:06:08.775160 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 220/451] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:08 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1751 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:08.841007 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f8244c10-7b13-4e14-a40f-a3441329e354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:08.841585 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f8244c10-7b13-4e14-a40f-a3441329e354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:08.847799 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f8244c10-7b13-4e14-a40f-a3441329e354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:08.848259 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f8244c10-7b13-4e14-a40f-a3441329e354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:08.849043 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f8244c10-7b13-4e14-a40f-a3441329e354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:08.849482 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f8244c10-7b13-4e14-a40f-a3441329e354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:08.882630 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f8244c10-7b13-4e14-a40f-a3441329e354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:08.883055 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f8244c10-7b13-4e14-a40f-a3441329e354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:08.883540 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.objects.instance [None req-f8244c10-7b13-4e14-a40f-a3441329e354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lazy-loading 'fault' on Instance uuid da290c35-0f36-4420-aaf8-d18fd9b906f0 {{(pid=117143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:06:08.928175 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f8244c10-7b13-4e14-a40f-a3441329e354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:08.936062 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f8244c10-7b13-4e14-a40f-a3441329e354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 200 len: 1331 microversion: 2.1 time: 0.099051 May 09 23:06:08.936652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 232/452] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:08 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:09.238499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e548ecaa-ba9e-4a21-9a6e-84ff78d4da43 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:09.239920 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e548ecaa-ba9e-4a21-9a6e-84ff78d4da43 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:09.247634 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e548ecaa-ba9e-4a21-9a6e-84ff78d4da43 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:09.248221 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e548ecaa-ba9e-4a21-9a6e-84ff78d4da43 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:09.249129 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e548ecaa-ba9e-4a21-9a6e-84ff78d4da43 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:09.249625 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e548ecaa-ba9e-4a21-9a6e-84ff78d4da43 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:09.380510 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-adbd9fef-73c9-460a-a6c8-767d97dcf6df tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:09.381353 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-adbd9fef-73c9-460a-a6c8-767d97dcf6df tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: 1e5e8a34-6fc9-49eb-a769-63373d0dc44c] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:09.388035 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-adbd9fef-73c9-460a-a6c8-767d97dcf6df tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:09.388782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-adbd9fef-73c9-460a-a6c8-767d97dcf6df tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:09.389788 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-adbd9fef-73c9-460a-a6c8-767d97dcf6df tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:09.390349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-adbd9fef-73c9-460a-a6c8-767d97dcf6df tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:09.399742 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e548ecaa-ba9e-4a21-9a6e-84ff78d4da43 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:09.407619 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-adbd9fef-73c9-460a-a6c8-767d97dcf6df tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] HTTP exception thrown: Instance 1e5e8a34-6fc9-49eb-a769-63373d0dc44c could not be found. May 09 23:06:09.408748 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e548ecaa-ba9e-4a21-9a6e-84ff78d4da43 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-adbd9fef-73c9-460a-a6c8-767d97dcf6df tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Request method failure captured: May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c HTTP/1.1 May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ4aasGiSwdN1vj93RhIKZbh5cZtf3P9r_OSIjobIb9vHGw52Gec_qLAGux49pMf3jazy9cHLgQwMm_zOD6Qln6wbQJ4su7tFEyroRS2F9UQjqQhivhF3CNEzMM6_fh_WW2vAh9ff3RkPPikTZXLuUU_8n8yOKiSeT3Ih0wx2Lsj5d8 May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 9a54785a57d74beb87b5a31f928583e7 May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-VolumesSnapshotTestJSON-361051361 May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:06:09.409254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:06:09.410646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9a54785a57d74beb87b5a31f928583e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9a54785a57d74beb87b5a31f928583e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9a54785a57d74beb87b5a31f928583e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9a54785a57d74beb87b5a31f928583e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:06:09.410646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-VolumesSnapshotTestJSON-361051361 May 09 23:06:09.410646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 9a54785a57d74beb87b5a31f928583e7 May 09 23:06:09.410646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-361051361 May 09 23:06:09.410646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-VolumesSnapshotTestJSON-361051361-project May 09 23:06:09.410646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:06:09.410646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:06:09.410646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 7d3e164b111b4c3784b220ef483bb5b9 May 09 23:06:09.410646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-VolumesSnapshotTestJSON-361051361-project May 09 23:06:09.410646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:06:09.410646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance 1e5e8a34-6fc9-49eb-a769-63373d0dc44c could not be found. May 09 23:06:09.410646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': '1e5e8a34-6fc9-49eb-a769-63373d0dc44c'} May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e5e8a34-6fc9-49eb-a769-63373d0dc44c could not be found. May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:06:09.411569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e5e8a34-6fc9-49eb-a769-63373d0dc44c could not be found. May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e5e8a34-6fc9-49eb-a769-63373d0dc44c could not be found. May 09 23:06:09.412983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:09.414368 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-adbd9fef-73c9-460a-a6c8-767d97dcf6df tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Returning 404 to user: Instance 1e5e8a34-6fc9-49eb-a769-63373d0dc44c could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:06:09.414458 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e548ecaa-ba9e-4a21-9a6e-84ff78d4da43 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:09.414569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-adbd9fef-73c9-460a-a6c8-767d97dcf6df tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c" status: 404 len: 111 microversion: 2.1 time: 0.034389 May 09 23:06:09.414569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 233/453] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:09 2022] GET /compute/v2.1/servers/1e5e8a34-6fc9-49eb-a769-63373d0dc44c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 23:06:09.414915 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e548ecaa-ba9e-4a21-9a6e-84ff78d4da43 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1808 microversion: 2.20 time: 0.180447 May 09 23:06:09.415506 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 221/454] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:06:09 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:06:09.454850 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-115b7fd3-100a-4f9e-b2fc-d5b5bc6af5e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:09.455493 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-115b7fd3-100a-4f9e-b2fc-d5b5bc6af5e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:09.461298 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-115b7fd3-100a-4f9e-b2fc-d5b5bc6af5e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:09.461755 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-115b7fd3-100a-4f9e-b2fc-d5b5bc6af5e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:09.462555 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-115b7fd3-100a-4f9e-b2fc-d5b5bc6af5e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:09.463052 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-115b7fd3-100a-4f9e-b2fc-d5b5bc6af5e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:09.597114 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-115b7fd3-100a-4f9e-b2fc-d5b5bc6af5e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:09.605736 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-115b7fd3-100a-4f9e-b2fc-d5b5bc6af5e7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.155254 May 09 23:06:09.606397 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 234/455] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:09 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:09.782433 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a4290355-1bca-4b86-8174-fc4673c2ab40 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:09.783045 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a4290355-1bca-4b86-8174-fc4673c2ab40 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:09.788819 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a4290355-1bca-4b86-8174-fc4673c2ab40 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:09.789270 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a4290355-1bca-4b86-8174-fc4673c2ab40 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:09.790031 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a4290355-1bca-4b86-8174-fc4673c2ab40 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:09.790488 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a4290355-1bca-4b86-8174-fc4673c2ab40 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:09.927072 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a4290355-1bca-4b86-8174-fc4673c2ab40 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:09.934732 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a4290355-1bca-4b86-8174-fc4673c2ab40 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.156230 May 09 23:06:09.935301 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 222/456] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:09 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:09.953841 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ef10528e-3aa6-49bf-aaf4-9c49c194867a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:09.954495 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ef10528e-3aa6-49bf-aaf4-9c49c194867a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:09.960369 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ef10528e-3aa6-49bf-aaf4-9c49c194867a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:09.960819 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ef10528e-3aa6-49bf-aaf4-9c49c194867a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:09.961587 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ef10528e-3aa6-49bf-aaf4-9c49c194867a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:09.962020 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ef10528e-3aa6-49bf-aaf4-9c49c194867a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:09.975487 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-ef10528e-3aa6-49bf-aaf4-9c49c194867a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] HTTP exception thrown: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ef10528e-3aa6-49bf-aaf4-9c49c194867a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Request method failure captured: May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 HTTP/1.1 May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ2AZq5EfNRX4A2tCiVwicbnfgrKkrL1gKGZ2i9kDkpeQEVnPD6CHxNPMLHcnk-nNrqb42O05Dml9fFcVJ8tZC-e8-FzgQMzIs0cjdHVhCDJH8lgSgXK8gUI8fFy_4mLaumbFrU7L_T2O0x7fdFRFsthOIPJ0V_6K6OxmafCQoxWJqE May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:06:09.976976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:06:09.978507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b776734a879d4c0785b1d3728b79b766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:06:09.978507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:06:09.978507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:06:09.978507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:06:09.978507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:06:09.978507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:06:09.978507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:06:09.978507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 84a45506c19c4cda8173c164a097f925 May 09 23:06:09.978507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:06:09.978507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:06:09.978507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:06:09.978507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': 'da290c35-0f36-4420-aaf8-d18fd9b906f0'} May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:06:09.979337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:06:09.980677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:09.982437 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ef10528e-3aa6-49bf-aaf4-9c49c194867a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Returning 404 to user: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:06:09.982437 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ef10528e-3aa6-49bf-aaf4-9c49c194867a tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 404 len: 111 microversion: 2.1 time: 0.028352 May 09 23:06:09.982437 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 235/457] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:09 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:06:09.988198 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-b92cc8f0-705d-4931-8a9d-1cad24dee82b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '.version_select at 0x7fc28bc19820>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:10.004874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-b92cc8f0-705d-4931-8a9d-1cad24dee82b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-998208448" status: 202 len: 0 microversion: 2.1 time: 0.021104 May 09 23:06:10.005425 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 223/458] 10.222.0.23 () {58 vars in 1217 bytes} [Mon May 9 23:06:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-998208448 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:06:10.432738 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2e6f5cde-464d-497e-a3bf-15409c57ee37 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:10.433356 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2e6f5cde-464d-497e-a3bf-15409c57ee37 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:10.439801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2e6f5cde-464d-497e-a3bf-15409c57ee37 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:10.440253 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2e6f5cde-464d-497e-a3bf-15409c57ee37 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:10.441025 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2e6f5cde-464d-497e-a3bf-15409c57ee37 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:10.441462 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2e6f5cde-464d-497e-a3bf-15409c57ee37 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:10.574735 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2e6f5cde-464d-497e-a3bf-15409c57ee37 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:10.583089 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2e6f5cde-464d-497e-a3bf-15409c57ee37 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:10.584619 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2e6f5cde-464d-497e-a3bf-15409c57ee37 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:10.585779 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2e6f5cde-464d-497e-a3bf-15409c57ee37 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1795 microversion: 2.20 time: 0.157010 May 09 23:06:10.589455 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 236/459] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:06:10 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:06:10.618568 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0cf2962a-819d-4919-b716-3172a01736fe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Action: 'create', calling method: .version_select at 0x7fc28bac88b0>, body: {"keypair": {"name": "tempest-keypair-1095955096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEj+anU9Q2nFxft0SLagl4Ge0r5L+i/bUhMeUVxGLOE7ynSmxczc2yAWQK4EKZwWlm37zvijBp7868oXPWQn6G4hIJ2an/peIAByi93K0J5fP9o2bvphZRnjmIVnfrSWQ=="}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:10.624133 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ae2df2ec-6996-43be-8564-1b6c71236095 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:10.624955 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ae2df2ec-6996-43be-8564-1b6c71236095 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:10.631674 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae2df2ec-6996-43be-8564-1b6c71236095 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:10.632321 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae2df2ec-6996-43be-8564-1b6c71236095 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:10.633167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae2df2ec-6996-43be-8564-1b6c71236095 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:10.633667 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae2df2ec-6996-43be-8564-1b6c71236095 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:10.638571 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-0cf2962a-819d-4919-b716-3172a01736fe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for project b776734a879d4c0785b1d3728b79b766. Resources: {'key_pairs'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:06:10.643185 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-0cf2962a-819d-4919-b716-3172a01736fe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for user 84a45506c19c4cda8173c164a097f925 and project b776734a879d4c0785b1d3728b79b766. Resources: {'key_pairs'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:06:10.666826 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0cf2962a-819d-4919-b716-3172a01736fe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053213 May 09 23:06:10.667435 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 224/460] 10.222.0.23 () {60 vars in 1158 bytes} [Mon May 9 23:06:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:06:10.766418 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ae2df2ec-6996-43be-8564-1b6c71236095 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:10.774965 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ae2df2ec-6996-43be-8564-1b6c71236095 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.155119 May 09 23:06:10.775552 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 237/461] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:10 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:10.952107 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-485efa1d-ef89-4a73-862b-a9898e143955 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:10.952657 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-485efa1d-ef89-4a73-862b-a9898e143955 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:10.959596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-485efa1d-ef89-4a73-862b-a9898e143955 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:10.960051 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-485efa1d-ef89-4a73-862b-a9898e143955 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:10.960832 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-485efa1d-ef89-4a73-862b-a9898e143955 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:10.961271 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-485efa1d-ef89-4a73-862b-a9898e143955 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:11.139256 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-485efa1d-ef89-4a73-862b-a9898e143955 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:11.147621 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-485efa1d-ef89-4a73-862b-a9898e143955 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.199486 May 09 23:06:11.148201 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 225/462] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:10 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:11.792801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-89a8ddb0-52ec-43f9-bc44-d28864802196 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:11.793404 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-89a8ddb0-52ec-43f9-bc44-d28864802196 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:11.807278 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-89a8ddb0-52ec-43f9-bc44-d28864802196 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:11.807742 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-89a8ddb0-52ec-43f9-bc44-d28864802196 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:11.808531 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-89a8ddb0-52ec-43f9-bc44-d28864802196 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:11.808968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-89a8ddb0-52ec-43f9-bc44-d28864802196 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:11.962033 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-89a8ddb0-52ec-43f9-bc44-d28864802196 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:11.969898 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-89a8ddb0-52ec-43f9-bc44-d28864802196 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.180982 May 09 23:06:11.970526 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 238/463] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:11 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:12.007832 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1059443710", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8d1714e-6adf-478e-9341-0aabd043adfd"}], "security_groups": [{"name": "tempest-securitygroup--1141734938"}], "key_name": "tempest-keypair-1095955096", "user_data": "}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:12.105231 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.network.neutron [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] validate_networks() for [('a8d1714e-6adf-478e-9341-0aabd043adfd', None, None, None, None, None)] {{(pid=117142) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:06:12.164667 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-666b1df3-e732-4a29-a29b-a8e10f93152c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:12.165277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-666b1df3-e732-4a29-a29b-a8e10f93152c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:12.171031 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-666b1df3-e732-4a29-a29b-a8e10f93152c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:12.171482 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-666b1df3-e732-4a29-a29b-a8e10f93152c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:12.172868 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-666b1df3-e732-4a29-a29b-a8e10f93152c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:12.173303 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-666b1df3-e732-4a29-a29b-a8e10f93152c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:12.310841 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-666b1df3-e732-4a29-a29b-a8e10f93152c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:12.327620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-666b1df3-e732-4a29-a29b-a8e10f93152c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.166682 May 09 23:06:12.332325 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 239/464] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:12 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:12.467148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Flavor limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:06:12.467640 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Image limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:06:12.468279 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Flavor pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:06:12.468677 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Image pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:06:12.469624 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:06:12.478276 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:12.478877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:12.479873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:12.480319 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:12.497658 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for project b776734a879d4c0785b1d3728b79b766. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:06:12.501581 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for user 84a45506c19c4cda8173c164a097f925 and project b776734a879d4c0785b1d3728b79b766. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:06:12.512148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Going to run 1 instances... {{(pid=117142) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:06:12.514533 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:06:12.561035 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-af23bc82-7056-4014-830a-519ad7cc084e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.557393 May 09 23:06:12.561609 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 226/465] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:06:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:06:12.571363 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-42b520cc-9ea8-4eb9-88dd-87778082c9e5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:12.571954 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-42b520cc-9ea8-4eb9-88dd-87778082c9e5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:12.630595 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-42b520cc-9ea8-4eb9-88dd-87778082c9e5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:12.637838 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-42b520cc-9ea8-4eb9-88dd-87778082c9e5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1242 microversion: 2.1 time: 0.069978 May 09 23:06:12.642721 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 240/466] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:12 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:12.989971 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-3b4ed2c9-202e-4947-94d6-bf93e36a3ed4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:12.991407 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-3b4ed2c9-202e-4947-94d6-bf93e36a3ed4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:12.997377 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3b4ed2c9-202e-4947-94d6-bf93e36a3ed4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:12.997834 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3b4ed2c9-202e-4947-94d6-bf93e36a3ed4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:12.998656 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3b4ed2c9-202e-4947-94d6-bf93e36a3ed4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:12.999098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3b4ed2c9-202e-4947-94d6-bf93e36a3ed4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:13.133210 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-3b4ed2c9-202e-4947-94d6-bf93e36a3ed4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:13.141925 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-3b4ed2c9-202e-4947-94d6-bf93e36a3ed4 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.157446 May 09 23:06:13.142514 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 227/467] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:12 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:13.344345 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1cd6c7b4-481d-45ce-94a5-429fe7446e71 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:13.344859 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1cd6c7b4-481d-45ce-94a5-429fe7446e71 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:13.351995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1cd6c7b4-481d-45ce-94a5-429fe7446e71 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:13.352439 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1cd6c7b4-481d-45ce-94a5-429fe7446e71 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:13.353206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1cd6c7b4-481d-45ce-94a5-429fe7446e71 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:13.353640 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1cd6c7b4-481d-45ce-94a5-429fe7446e71 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:13.499796 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1cd6c7b4-481d-45ce-94a5-429fe7446e71 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:13.514863 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1cd6c7b4-481d-45ce-94a5-429fe7446e71 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.174387 May 09 23:06:13.515720 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 241/468] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:13 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:13.655851 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-724b11b6-e047-47e1-b7a3-796dd89445da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:13.657014 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-724b11b6-e047-47e1-b7a3-796dd89445da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:13.662925 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-724b11b6-e047-47e1-b7a3-796dd89445da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:13.663376 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-724b11b6-e047-47e1-b7a3-796dd89445da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:13.664154 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-724b11b6-e047-47e1-b7a3-796dd89445da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:13.664593 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-724b11b6-e047-47e1-b7a3-796dd89445da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:13.737788 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-724b11b6-e047-47e1-b7a3-796dd89445da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:13.744975 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-724b11b6-e047-47e1-b7a3-796dd89445da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1300 microversion: 2.1 time: 0.093633 May 09 23:06:13.746417 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 228/469] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:13 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:14.160122 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f110b1bd-3bbf-4deb-86ba-62cabcf404fa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:14.160734 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f110b1bd-3bbf-4deb-86ba-62cabcf404fa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:14.168466 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f110b1bd-3bbf-4deb-86ba-62cabcf404fa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:14.169561 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f110b1bd-3bbf-4deb-86ba-62cabcf404fa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:14.170448 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f110b1bd-3bbf-4deb-86ba-62cabcf404fa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:14.170947 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f110b1bd-3bbf-4deb-86ba-62cabcf404fa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:14.308790 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f110b1bd-3bbf-4deb-86ba-62cabcf404fa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:14.326382 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f110b1bd-3bbf-4deb-86ba-62cabcf404fa tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.169266 May 09 23:06:14.327290 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 242/470] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:14 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:14.531871 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cd630fbc-fb9b-4aae-8a89-aff97846cdfe tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:14.532518 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cd630fbc-fb9b-4aae-8a89-aff97846cdfe tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:14.539236 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd630fbc-fb9b-4aae-8a89-aff97846cdfe tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:14.539691 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd630fbc-fb9b-4aae-8a89-aff97846cdfe tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:14.540485 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd630fbc-fb9b-4aae-8a89-aff97846cdfe tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:14.540925 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd630fbc-fb9b-4aae-8a89-aff97846cdfe tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:14.763396 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-59321fc3-f1ee-42d3-812a-a8c2e4abd1b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:14.763945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-59321fc3-f1ee-42d3-812a-a8c2e4abd1b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:14.770590 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-59321fc3-f1ee-42d3-812a-a8c2e4abd1b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:14.771034 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-59321fc3-f1ee-42d3-812a-a8c2e4abd1b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:14.771905 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-59321fc3-f1ee-42d3-812a-a8c2e4abd1b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:14.772472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-59321fc3-f1ee-42d3-812a-a8c2e4abd1b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:14.900638 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-59321fc3-f1ee-42d3-812a-a8c2e4abd1b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:14.908119 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-59321fc3-f1ee-42d3-812a-a8c2e4abd1b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1368 microversion: 2.1 time: 0.148558 May 09 23:06:14.908970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 243/471] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:14 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:14.934527 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cd630fbc-fb9b-4aae-8a89-aff97846cdfe tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:14.943667 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cd630fbc-fb9b-4aae-8a89-aff97846cdfe tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.415387 May 09 23:06:14.944067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 229/472] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:14 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:15.168674 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-27386af1-939d-4791-aa3a-72416360032e req-652237bb-d8ed-447d-a9fc-8b82595cfe6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ea1b8e-49ff-4716-8cbf-ca11225258aa", "tag": "49e0cd49-aaf5-4ce6-b0b4-5c7345fa279e"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:15.179113 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-27386af1-939d-4791-aa3a-72416360032e req-652237bb-d8ed-447d-a9fc-8b82595cfe6b service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:15.181256 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-27386af1-939d-4791-aa3a-72416360032e req-652237bb-d8ed-447d-a9fc-8b82595cfe6b service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:15.193532 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-27386af1-939d-4791-aa3a-72416360032e req-652237bb-d8ed-447d-a9fc-8b82595cfe6b service nova] Creating event network-changed:49e0cd49-aaf5-4ce6-b0b4-5c7345fa279e for instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa on hv-cinder-84067 May 09 23:06:15.198526 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-27386af1-939d-4791-aa3a-72416360032e req-652237bb-d8ed-447d-a9fc-8b82595cfe6b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033462 May 09 23:06:15.199130 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 244/473] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:06:15.344862 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ea093e86-ad21-46ac-b704-375d5df8ca71 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:15.345466 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ea093e86-ad21-46ac-b704-375d5df8ca71 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:15.351775 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ea093e86-ad21-46ac-b704-375d5df8ca71 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:15.352226 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ea093e86-ad21-46ac-b704-375d5df8ca71 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:15.352992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ea093e86-ad21-46ac-b704-375d5df8ca71 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:15.353419 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ea093e86-ad21-46ac-b704-375d5df8ca71 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:15.478011 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ea093e86-ad21-46ac-b704-375d5df8ca71 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:15.486584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ea093e86-ad21-46ac-b704-375d5df8ca71 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.146174 May 09 23:06:15.487148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 230/474] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:15 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:15.928183 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-cc0c22b9-f57d-430e-9650-023496380fed tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:15.928791 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-cc0c22b9-f57d-430e-9650-023496380fed tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:15.934844 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cc0c22b9-f57d-430e-9650-023496380fed tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:15.935284 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cc0c22b9-f57d-430e-9650-023496380fed tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:15.936032 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cc0c22b9-f57d-430e-9650-023496380fed tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:15.936461 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cc0c22b9-f57d-430e-9650-023496380fed tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:15.960586 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c103c711-cc50-4c20-ae6c-2338124b186f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:15.961230 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c103c711-cc50-4c20-ae6c-2338124b186f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:15.967524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c103c711-cc50-4c20-ae6c-2338124b186f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:15.967975 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c103c711-cc50-4c20-ae6c-2338124b186f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:15.969267 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c103c711-cc50-4c20-ae6c-2338124b186f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:15.969701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c103c711-cc50-4c20-ae6c-2338124b186f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:16.068377 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-cc0c22b9-f57d-430e-9650-023496380fed tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:16.077270 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-cc0c22b9-f57d-430e-9650-023496380fed tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1368 microversion: 2.1 time: 0.153152 May 09 23:06:16.078166 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 245/475] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:15 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:16.123123 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c103c711-cc50-4c20-ae6c-2338124b186f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:16.130974 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c103c711-cc50-4c20-ae6c-2338124b186f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.174205 May 09 23:06:16.131541 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 231/476] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:15 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:16.503688 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-24770fb0-d0ee-4306-aeed-00f58513c268 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:16.504301 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-24770fb0-d0ee-4306-aeed-00f58513c268 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:16.510212 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-24770fb0-d0ee-4306-aeed-00f58513c268 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:16.510668 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-24770fb0-d0ee-4306-aeed-00f58513c268 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:16.511433 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-24770fb0-d0ee-4306-aeed-00f58513c268 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:16.511873 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-24770fb0-d0ee-4306-aeed-00f58513c268 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:16.636084 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-24770fb0-d0ee-4306-aeed-00f58513c268 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:16.644570 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-24770fb0-d0ee-4306-aeed-00f58513c268 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.144953 May 09 23:06:16.645144 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 246/477] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:16 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:17.094472 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fa393043-7d87-4400-95bd-ab6ae72680fd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:17.095206 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-fa393043-7d87-4400-95bd-ab6ae72680fd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:17.108017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fa393043-7d87-4400-95bd-ab6ae72680fd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:17.108475 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fa393043-7d87-4400-95bd-ab6ae72680fd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:17.109786 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fa393043-7d87-4400-95bd-ab6ae72680fd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:17.110251 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fa393043-7d87-4400-95bd-ab6ae72680fd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:17.148623 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-34cf434b-c5d1-46ad-b634-5f20922b15ec tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:17.149374 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-34cf434b-c5d1-46ad-b634-5f20922b15ec tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:17.156517 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-34cf434b-c5d1-46ad-b634-5f20922b15ec tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:17.156996 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-34cf434b-c5d1-46ad-b634-5f20922b15ec tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:17.157805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-34cf434b-c5d1-46ad-b634-5f20922b15ec tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:17.158231 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-34cf434b-c5d1-46ad-b634-5f20922b15ec tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:17.304511 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-34cf434b-c5d1-46ad-b634-5f20922b15ec tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:17.312955 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-34cf434b-c5d1-46ad-b634-5f20922b15ec tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.167884 May 09 23:06:17.314152 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 247/478] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:17 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:17.325585 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-494378989", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "networks": [{"uuid": "378d612b-31ab-4d07-8c08-26e101d40f29"}]}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:17.331469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-fa393043-7d87-4400-95bd-ab6ae72680fd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:17.341330 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-fa393043-7d87-4400-95bd-ab6ae72680fd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1368 microversion: 2.1 time: 0.250730 May 09 23:06:17.341922 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 232/479] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:17 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:17.384138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.network.neutron [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] validate_networks() for [('378d612b-31ab-4d07-8c08-26e101d40f29', None, None, None, None, None)] {{(pid=117143) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:06:17.660719 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-53cd0cf7-9667-4239-bb23-bab150c98cfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:17.661333 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-53cd0cf7-9667-4239-bb23-bab150c98cfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:17.667276 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-53cd0cf7-9667-4239-bb23-bab150c98cfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:17.667730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-53cd0cf7-9667-4239-bb23-bab150c98cfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:17.669902 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-53cd0cf7-9667-4239-bb23-bab150c98cfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:17.670378 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-53cd0cf7-9667-4239-bb23-bab150c98cfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:17.737872 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Flavor limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:06:17.738369 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Image limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:06:17.739512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Flavor pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:06:17.739512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Image pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:06:17.739762 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:06:17.748308 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:17.748759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:17.749562 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:17.750598 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:17.766698 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Getting quotas for project 9a54785a57d74beb87b5a31f928583e7. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:06:17.770545 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Getting quotas for user 7d3e164b111b4c3784b220ef483bb5b9 and project 9a54785a57d74beb87b5a31f928583e7. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:06:17.781237 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Going to run 1 instances... {{(pid=117143) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:06:17.783528 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:06:17.803620 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-53cd0cf7-9667-4239-bb23-bab150c98cfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:17.813107 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-53cd0cf7-9667-4239-bb23-bab150c98cfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.155517 May 09 23:06:17.813946 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 233/480] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:17 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:17.827213 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-92bee5f3-1e7d-402a-8a84-b7c5ddf65204 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512483 May 09 23:06:17.828064 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 248/481] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:06:17.837688 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-be6a65df-ac28-4bea-b053-c04e6735c8db tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:17.838350 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-be6a65df-ac28-4bea-b053-c04e6735c8db tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:17.890505 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-be6a65df-ac28-4bea-b053-c04e6735c8db tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:17.897132 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-be6a65df-ac28-4bea-b053-c04e6735c8db tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d" status: 200 len: 1218 microversion: 2.1 time: 0.063282 May 09 23:06:17.897744 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 234/482] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:17 2022] GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:18.330445 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-63dd179f-2c90-4cdf-8e52-5bc57ff08e2f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:18.331059 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-63dd179f-2c90-4cdf-8e52-5bc57ff08e2f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:18.337029 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-63dd179f-2c90-4cdf-8e52-5bc57ff08e2f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:18.337483 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-63dd179f-2c90-4cdf-8e52-5bc57ff08e2f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:18.338280 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-63dd179f-2c90-4cdf-8e52-5bc57ff08e2f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:18.338719 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-63dd179f-2c90-4cdf-8e52-5bc57ff08e2f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:18.359183 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-2e79845f-6813-4b98-9214-483e66aaa036 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:18.360524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-2e79845f-6813-4b98-9214-483e66aaa036 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:18.367497 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2e79845f-6813-4b98-9214-483e66aaa036 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:18.367953 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2e79845f-6813-4b98-9214-483e66aaa036 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:18.368763 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2e79845f-6813-4b98-9214-483e66aaa036 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:18.369206 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2e79845f-6813-4b98-9214-483e66aaa036 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:18.481072 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-63dd179f-2c90-4cdf-8e52-5bc57ff08e2f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:18.492906 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-63dd179f-2c90-4cdf-8e52-5bc57ff08e2f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.166453 May 09 23:06:18.493594 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 249/483] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:18 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:18.501757 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-2e79845f-6813-4b98-9214-483e66aaa036 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:18.512079 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-2e79845f-6813-4b98-9214-483e66aaa036 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1368 microversion: 2.1 time: 0.156919 May 09 23:06:18.512671 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 235/484] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:18 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:18.831719 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-506d3a88-bb2e-4211-b98b-45bb4c3063c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:18.832360 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-506d3a88-bb2e-4211-b98b-45bb4c3063c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:18.838663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-506d3a88-bb2e-4211-b98b-45bb4c3063c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:18.839058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-506d3a88-bb2e-4211-b98b-45bb4c3063c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:18.839838 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-506d3a88-bb2e-4211-b98b-45bb4c3063c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:18.840266 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-506d3a88-bb2e-4211-b98b-45bb4c3063c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:18.914762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-88618cfd-3b75-4b86-9915-b44813bf6e6a tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:18.915433 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-88618cfd-3b75-4b86-9915-b44813bf6e6a tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:18.927284 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-88618cfd-3b75-4b86-9915-b44813bf6e6a tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:18.927744 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-88618cfd-3b75-4b86-9915-b44813bf6e6a tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:18.928539 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-88618cfd-3b75-4b86-9915-b44813bf6e6a tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:18.929055 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-88618cfd-3b75-4b86-9915-b44813bf6e6a tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:18.976177 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-506d3a88-bb2e-4211-b98b-45bb4c3063c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:18.984684 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-506d3a88-bb2e-4211-b98b-45bb4c3063c0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.157766 May 09 23:06:18.985265 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 250/485] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:18 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:18.991891 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-88618cfd-3b75-4b86-9915-b44813bf6e6a tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:18.999135 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-88618cfd-3b75-4b86-9915-b44813bf6e6a tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d" status: 200 len: 1270 microversion: 2.1 time: 0.088508 May 09 23:06:19.000264 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 236/486] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:18 2022] GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:19.510348 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-460c863f-0a76-487b-906c-7ac53c2a95d9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:19.510974 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-460c863f-0a76-487b-906c-7ac53c2a95d9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:19.517319 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-460c863f-0a76-487b-906c-7ac53c2a95d9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:19.517833 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-460c863f-0a76-487b-906c-7ac53c2a95d9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:19.518642 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-460c863f-0a76-487b-906c-7ac53c2a95d9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:19.519078 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-460c863f-0a76-487b-906c-7ac53c2a95d9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:19.528960 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5614ca1e-3267-4bc1-9b2e-e2ac15bf2775 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:19.529571 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5614ca1e-3267-4bc1-9b2e-e2ac15bf2775 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:19.545259 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5614ca1e-3267-4bc1-9b2e-e2ac15bf2775 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:19.545709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5614ca1e-3267-4bc1-9b2e-e2ac15bf2775 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:19.546524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5614ca1e-3267-4bc1-9b2e-e2ac15bf2775 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:19.547499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5614ca1e-3267-4bc1-9b2e-e2ac15bf2775 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:19.684974 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5614ca1e-3267-4bc1-9b2e-e2ac15bf2775 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:19.693149 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5614ca1e-3267-4bc1-9b2e-e2ac15bf2775 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1368 microversion: 2.1 time: 0.167881 May 09 23:06:19.693743 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 237/487] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:19 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:19.965055 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-460c863f-0a76-487b-906c-7ac53c2a95d9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:19.973414 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-460c863f-0a76-487b-906c-7ac53c2a95d9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.467114 May 09 23:06:19.973983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 251/488] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:19 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:20.001158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-715d1da8-6628-4c8d-8586-17e9258c7487 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:20.001900 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-715d1da8-6628-4c8d-8586-17e9258c7487 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:20.007871 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-715d1da8-6628-4c8d-8586-17e9258c7487 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:20.008354 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-715d1da8-6628-4c8d-8586-17e9258c7487 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:20.009223 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-715d1da8-6628-4c8d-8586-17e9258c7487 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:20.009731 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-715d1da8-6628-4c8d-8586-17e9258c7487 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:20.017720 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0398e29a-b140-4620-8227-0d35d8de8941 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:20.018494 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-0398e29a-b140-4620-8227-0d35d8de8941 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:20.024698 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0398e29a-b140-4620-8227-0d35d8de8941 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:20.025386 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0398e29a-b140-4620-8227-0d35d8de8941 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:20.026502 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0398e29a-b140-4620-8227-0d35d8de8941 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:20.027143 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0398e29a-b140-4620-8227-0d35d8de8941 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:20.167087 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-715d1da8-6628-4c8d-8586-17e9258c7487 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:20.175643 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-715d1da8-6628-4c8d-8586-17e9258c7487 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.178257 May 09 23:06:20.176151 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 238/489] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:19 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:20.245835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-0398e29a-b140-4620-8227-0d35d8de8941 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:20.253608 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-0398e29a-b140-4620-8227-0d35d8de8941 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d" status: 200 len: 1318 microversion: 2.1 time: 0.240775 May 09 23:06:20.254423 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 252/490] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:20 2022] GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:20.710107 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1b9fd643-2bcc-4be7-9e69-83d5bfc3adfe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:20.710752 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1b9fd643-2bcc-4be7-9e69-83d5bfc3adfe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:20.718380 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b9fd643-2bcc-4be7-9e69-83d5bfc3adfe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:20.719423 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b9fd643-2bcc-4be7-9e69-83d5bfc3adfe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:20.722255 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b9fd643-2bcc-4be7-9e69-83d5bfc3adfe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:20.722255 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b9fd643-2bcc-4be7-9e69-83d5bfc3adfe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:20.805536 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-813b5bba-1f05-441a-bee9-2d95c93a2c02 req-e49ce0e5-5a25-4262-ae4d-d14066587473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf9ab5d-6496-440d-8d1c-7e83d1d7386d", "tag": "dbdbce6a-9c78-4254-8fbd-830828ffb663"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:20.819268 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-813b5bba-1f05-441a-bee9-2d95c93a2c02 req-e49ce0e5-5a25-4262-ae4d-d14066587473 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:20.820785 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-813b5bba-1f05-441a-bee9-2d95c93a2c02 req-e49ce0e5-5a25-4262-ae4d-d14066587473 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:20.847578 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-813b5bba-1f05-441a-bee9-2d95c93a2c02 req-e49ce0e5-5a25-4262-ae4d-d14066587473 service nova] Creating event network-changed:dbdbce6a-9c78-4254-8fbd-830828ffb663 for instance fbf9ab5d-6496-440d-8d1c-7e83d1d7386d on hv-cinder-84067 May 09 23:06:20.855019 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-813b5bba-1f05-441a-bee9-2d95c93a2c02 req-e49ce0e5-5a25-4262-ae4d-d14066587473 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053780 May 09 23:06:20.856022 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 253/491] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:06:20.885536 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1b9fd643-2bcc-4be7-9e69-83d5bfc3adfe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:20.893893 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1b9fd643-2bcc-4be7-9e69-83d5bfc3adfe tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1368 microversion: 2.1 time: 0.187603 May 09 23:06:20.894518 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 239/492] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:20 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:20.939738 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-57b9811c-ef0c-4e25-825b-81e7924d7876 req-6c0acff3-4216-4b59-ba06-d6007533defd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ea1b8e-49ff-4716-8cbf-ca11225258aa", "name": "network-vif-plugged", "status": "completed", "tag": "49e0cd49-aaf5-4ce6-b0b4-5c7345fa279e"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:20.949476 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-57b9811c-ef0c-4e25-825b-81e7924d7876 req-6c0acff3-4216-4b59-ba06-d6007533defd service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:20.950242 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-57b9811c-ef0c-4e25-825b-81e7924d7876 req-6c0acff3-4216-4b59-ba06-d6007533defd service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:20.962682 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-57b9811c-ef0c-4e25-825b-81e7924d7876 req-6c0acff3-4216-4b59-ba06-d6007533defd service nova] Creating event network-vif-plugged:49e0cd49-aaf5-4ce6-b0b4-5c7345fa279e for instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa on hv-cinder-84067 May 09 23:06:20.967932 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-57b9811c-ef0c-4e25-825b-81e7924d7876 req-6c0acff3-4216-4b59-ba06-d6007533defd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033076 May 09 23:06:20.969248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 254/493] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:06:20.991213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c8e6d343-a151-4789-9131-438286b31c46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:20.992072 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c8e6d343-a151-4789-9131-438286b31c46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:20.998839 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c8e6d343-a151-4789-9131-438286b31c46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:20.999289 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c8e6d343-a151-4789-9131-438286b31c46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:21.000685 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c8e6d343-a151-4789-9131-438286b31c46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:21.001122 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c8e6d343-a151-4789-9131-438286b31c46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:21.194321 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c8e6d343-a151-4789-9131-438286b31c46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:21.194542 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f8157e02-420f-4dbe-a760-cdd92073caa2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:21.195344 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f8157e02-420f-4dbe-a760-cdd92073caa2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:21.201548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f8157e02-420f-4dbe-a760-cdd92073caa2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:21.202137 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f8157e02-420f-4dbe-a760-cdd92073caa2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:21.202331 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c8e6d343-a151-4789-9131-438286b31c46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.214978 May 09 23:06:21.205474 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 240/494] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:20 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:21.205642 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f8157e02-420f-4dbe-a760-cdd92073caa2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:21.205642 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f8157e02-420f-4dbe-a760-cdd92073caa2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:21.271201 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-838d0f03-10ad-4820-aac8-b75ab19ac3b3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:21.271810 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-838d0f03-10ad-4820-aac8-b75ab19ac3b3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:21.277591 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-838d0f03-10ad-4820-aac8-b75ab19ac3b3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:21.278044 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-838d0f03-10ad-4820-aac8-b75ab19ac3b3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:21.278832 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-838d0f03-10ad-4820-aac8-b75ab19ac3b3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:21.279262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-838d0f03-10ad-4820-aac8-b75ab19ac3b3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:21.346341 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f8157e02-420f-4dbe-a760-cdd92073caa2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:21.354044 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f8157e02-420f-4dbe-a760-cdd92073caa2 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.164506 May 09 23:06:21.354847 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 255/495] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:21 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:21.407267 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-838d0f03-10ad-4820-aac8-b75ab19ac3b3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:21.414489 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-838d0f03-10ad-4820-aac8-b75ab19ac3b3 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d" status: 200 len: 1318 microversion: 2.1 time: 0.147064 May 09 23:06:21.415055 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 241/496] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:21 2022] GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:21.910533 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7ace72ed-7656-4ef0-925e-99252d4bd4b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:21.911073 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7ace72ed-7656-4ef0-925e-99252d4bd4b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:21.917292 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7ace72ed-7656-4ef0-925e-99252d4bd4b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:21.917715 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7ace72ed-7656-4ef0-925e-99252d4bd4b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:21.918509 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7ace72ed-7656-4ef0-925e-99252d4bd4b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:21.918937 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7ace72ed-7656-4ef0-925e-99252d4bd4b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:22.047131 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7ace72ed-7656-4ef0-925e-99252d4bd4b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:22.054528 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7ace72ed-7656-4ef0-925e-99252d4bd4b1 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1368 microversion: 2.1 time: 0.147921 May 09 23:06:22.055107 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 256/497] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:21 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:22.220061 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-2e167a59-7938-415a-ac96-5cf1a1bda0e3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:22.220616 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-2e167a59-7938-415a-ac96-5cf1a1bda0e3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:22.226890 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2e167a59-7938-415a-ac96-5cf1a1bda0e3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:22.227331 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2e167a59-7938-415a-ac96-5cf1a1bda0e3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:22.228079 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2e167a59-7938-415a-ac96-5cf1a1bda0e3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:22.228504 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2e167a59-7938-415a-ac96-5cf1a1bda0e3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:22.369440 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-2e167a59-7938-415a-ac96-5cf1a1bda0e3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:22.371979 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-53721ce0-cfd9-4f2b-80b8-5fba6a7ffd37 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:22.372596 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-53721ce0-cfd9-4f2b-80b8-5fba6a7ffd37 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:22.377693 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-2e167a59-7938-415a-ac96-5cf1a1bda0e3 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.161486 May 09 23:06:22.378292 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 242/498] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:22 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:22.378435 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-53721ce0-cfd9-4f2b-80b8-5fba6a7ffd37 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:22.378888 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-53721ce0-cfd9-4f2b-80b8-5fba6a7ffd37 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:22.379741 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-53721ce0-cfd9-4f2b-80b8-5fba6a7ffd37 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:22.380176 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-53721ce0-cfd9-4f2b-80b8-5fba6a7ffd37 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:22.431996 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c1cfdec7-e78a-4677-a6fa-f0c132a365cc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:22.432718 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c1cfdec7-e78a-4677-a6fa-f0c132a365cc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:22.439365 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c1cfdec7-e78a-4677-a6fa-f0c132a365cc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:22.439851 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c1cfdec7-e78a-4677-a6fa-f0c132a365cc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:22.440636 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c1cfdec7-e78a-4677-a6fa-f0c132a365cc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:22.441072 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c1cfdec7-e78a-4677-a6fa-f0c132a365cc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:22.508653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-53721ce0-cfd9-4f2b-80b8-5fba6a7ffd37 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:22.517335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-53721ce0-cfd9-4f2b-80b8-5fba6a7ffd37 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.149105 May 09 23:06:22.517923 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 257/499] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:22 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:22.573540 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c1cfdec7-e78a-4677-a6fa-f0c132a365cc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:22.580972 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c1cfdec7-e78a-4677-a6fa-f0c132a365cc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d" status: 200 len: 1318 microversion: 2.1 time: 0.152834 May 09 23:06:22.581546 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 243/500] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:22 2022] GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:23.071568 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-4920948a-3a80-4709-a92b-9beda1235822 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:23.073165 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-4920948a-3a80-4709-a92b-9beda1235822 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:23.079900 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4920948a-3a80-4709-a92b-9beda1235822 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:23.080633 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4920948a-3a80-4709-a92b-9beda1235822 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:23.081371 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4920948a-3a80-4709-a92b-9beda1235822 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:23.081813 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4920948a-3a80-4709-a92b-9beda1235822 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:23.260142 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4920948a-3a80-4709-a92b-9beda1235822 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:23.267605 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-4920948a-3a80-4709-a92b-9beda1235822 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1368 microversion: 2.1 time: 0.200032 May 09 23:06:23.268180 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 258/501] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:23 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:23.394761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-481f1d18-cbae-4037-bd5a-7ed4380a3f7f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:23.395364 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-481f1d18-cbae-4037-bd5a-7ed4380a3f7f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:23.401500 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-481f1d18-cbae-4037-bd5a-7ed4380a3f7f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:23.401945 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-481f1d18-cbae-4037-bd5a-7ed4380a3f7f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:23.402745 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-481f1d18-cbae-4037-bd5a-7ed4380a3f7f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:23.403176 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-481f1d18-cbae-4037-bd5a-7ed4380a3f7f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:23.534849 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6145021c-1fa7-4446-9960-dc560afeccc7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:23.535467 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6145021c-1fa7-4446-9960-dc560afeccc7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:23.541686 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6145021c-1fa7-4446-9960-dc560afeccc7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:23.542157 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6145021c-1fa7-4446-9960-dc560afeccc7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:23.542935 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6145021c-1fa7-4446-9960-dc560afeccc7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:23.543374 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6145021c-1fa7-4446-9960-dc560afeccc7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:23.543676 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-481f1d18-cbae-4037-bd5a-7ed4380a3f7f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:23.551369 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-481f1d18-cbae-4037-bd5a-7ed4380a3f7f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.160368 May 09 23:06:23.551939 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 244/502] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:23 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:23.596576 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-21f43a18-1865-4f34-84fd-19daafa3cdf4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:23.597183 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-21f43a18-1865-4f34-84fd-19daafa3cdf4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:23.603067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-21f43a18-1865-4f34-84fd-19daafa3cdf4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:23.603572 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-21f43a18-1865-4f34-84fd-19daafa3cdf4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:23.604280 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-21f43a18-1865-4f34-84fd-19daafa3cdf4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:23.604717 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-21f43a18-1865-4f34-84fd-19daafa3cdf4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:23.675570 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6145021c-1fa7-4446-9960-dc560afeccc7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:23.683351 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6145021c-1fa7-4446-9960-dc560afeccc7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.152319 May 09 23:06:23.684111 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 259/503] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:23 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:23.732390 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-21f43a18-1865-4f34-84fd-19daafa3cdf4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:23.739572 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-21f43a18-1865-4f34-84fd-19daafa3cdf4 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d" status: 200 len: 1318 microversion: 2.1 time: 0.146788 May 09 23:06:23.740140 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 245/504] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:23 2022] GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:24.283594 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b86a4989-28af-4b52-a91c-8ebc7d8d9598 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:24.284216 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b86a4989-28af-4b52-a91c-8ebc7d8d9598 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:24.290559 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b86a4989-28af-4b52-a91c-8ebc7d8d9598 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:24.291009 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b86a4989-28af-4b52-a91c-8ebc7d8d9598 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:24.291777 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b86a4989-28af-4b52-a91c-8ebc7d8d9598 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:24.292215 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b86a4989-28af-4b52-a91c-8ebc7d8d9598 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:24.477102 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b86a4989-28af-4b52-a91c-8ebc7d8d9598 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:24.484660 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b86a4989-28af-4b52-a91c-8ebc7d8d9598 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1368 microversion: 2.1 time: 0.204880 May 09 23:06:24.485235 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 260/505] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:24 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:24.568415 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0c014ce8-ae07-4840-b81e-81bf52105c90 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:24.568987 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-0c014ce8-ae07-4840-b81e-81bf52105c90 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:24.575186 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0c014ce8-ae07-4840-b81e-81bf52105c90 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:24.575631 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0c014ce8-ae07-4840-b81e-81bf52105c90 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:24.576382 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0c014ce8-ae07-4840-b81e-81bf52105c90 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:24.576807 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0c014ce8-ae07-4840-b81e-81bf52105c90 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:24.700311 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5c78be15-e5fc-498f-9584-ed5824b5b645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:24.700916 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-5c78be15-e5fc-498f-9584-ed5824b5b645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:24.707375 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5c78be15-e5fc-498f-9584-ed5824b5b645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:24.707825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5c78be15-e5fc-498f-9584-ed5824b5b645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:24.708628 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5c78be15-e5fc-498f-9584-ed5824b5b645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:24.709064 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5c78be15-e5fc-498f-9584-ed5824b5b645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:24.717905 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-0c014ce8-ae07-4840-b81e-81bf52105c90 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:24.727015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0c014ce8-ae07-4840-b81e-81bf52105c90 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.162554 May 09 23:06:24.727752 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 246/506] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:24 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:24.757684 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e2d8796a-8f89-4bf2-9f8e-b3faeb0941e5 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:24.758413 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e2d8796a-8f89-4bf2-9f8e-b3faeb0941e5 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:24.768442 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e2d8796a-8f89-4bf2-9f8e-b3faeb0941e5 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:24.769023 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e2d8796a-8f89-4bf2-9f8e-b3faeb0941e5 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:24.770354 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e2d8796a-8f89-4bf2-9f8e-b3faeb0941e5 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:24.770881 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e2d8796a-8f89-4bf2-9f8e-b3faeb0941e5 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:24.878685 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-5c78be15-e5fc-498f-9584-ed5824b5b645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:24.892257 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-5c78be15-e5fc-498f-9584-ed5824b5b645 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.190004 May 09 23:06:24.892953 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 261/507] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:24 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:24.966087 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-809215c5-9e7e-4017-b03a-7b4f750f335a req-8b1a8504-44df-42ba-b365-17f39dcc33ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf9ab5d-6496-440d-8d1c-7e83d1d7386d", "name": "network-vif-plugged", "status": "completed", "tag": "dbdbce6a-9c78-4254-8fbd-830828ffb663"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:24.967572 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e2d8796a-8f89-4bf2-9f8e-b3faeb0941e5 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:24.975239 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-809215c5-9e7e-4017-b03a-7b4f750f335a req-8b1a8504-44df-42ba-b365-17f39dcc33ed service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:24.975686 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-809215c5-9e7e-4017-b03a-7b4f750f335a req-8b1a8504-44df-42ba-b365-17f39dcc33ed service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:24.986729 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e2d8796a-8f89-4bf2-9f8e-b3faeb0941e5 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d" status: 200 len: 1318 microversion: 2.1 time: 0.232836 May 09 23:06:24.987933 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 247/508] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:24 2022] GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:24.997023 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-809215c5-9e7e-4017-b03a-7b4f750f335a req-8b1a8504-44df-42ba-b365-17f39dcc33ed service nova] Creating event network-vif-plugged:dbdbce6a-9c78-4254-8fbd-830828ffb663 for instance fbf9ab5d-6496-440d-8d1c-7e83d1d7386d on hv-cinder-84067 May 09 23:06:25.004294 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-809215c5-9e7e-4017-b03a-7b4f750f335a req-8b1a8504-44df-42ba-b365-17f39dcc33ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042664 May 09 23:06:25.005207 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 262/509] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:06:25.501159 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a579bbfe-1ce3-4b74-ba0e-67f99c8fd06d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:25.501769 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a579bbfe-1ce3-4b74-ba0e-67f99c8fd06d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:25.507623 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a579bbfe-1ce3-4b74-ba0e-67f99c8fd06d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:25.508085 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a579bbfe-1ce3-4b74-ba0e-67f99c8fd06d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:25.508851 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a579bbfe-1ce3-4b74-ba0e-67f99c8fd06d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:25.509290 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a579bbfe-1ce3-4b74-ba0e-67f99c8fd06d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:25.634959 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a579bbfe-1ce3-4b74-ba0e-67f99c8fd06d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:25.643114 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a579bbfe-1ce3-4b74-ba0e-67f99c8fd06d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1559 microversion: 2.1 time: 0.145759 May 09 23:06:25.643704 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 248/510] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:25 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:25.660598 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-202c9b38-8795-4dd6-bb56-a32eacb1760c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:25.661114 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-202c9b38-8795-4dd6-bb56-a32eacb1760c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:25.667142 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-202c9b38-8795-4dd6-bb56-a32eacb1760c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:25.667583 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-202c9b38-8795-4dd6-bb56-a32eacb1760c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:25.668340 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-202c9b38-8795-4dd6-bb56-a32eacb1760c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:25.668760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-202c9b38-8795-4dd6-bb56-a32eacb1760c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:25.747495 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-360166f6-4cd0-4a65-a2d3-455d43ccf386 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:25.748614 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-360166f6-4cd0-4a65-a2d3-455d43ccf386 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:25.752390 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-202c9b38-8795-4dd6-bb56-a32eacb1760c tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096332 May 09 23:06:25.753061 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 263/511] 10.222.0.23 () {58 vars in 1274 bytes} [Mon May 9 23:06:25 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:06:25.756501 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-360166f6-4cd0-4a65-a2d3-455d43ccf386 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:25.756501 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-360166f6-4cd0-4a65-a2d3-455d43ccf386 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:25.756501 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-360166f6-4cd0-4a65-a2d3-455d43ccf386 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:25.756800 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-360166f6-4cd0-4a65-a2d3-455d43ccf386 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:25.900139 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-360166f6-4cd0-4a65-a2d3-455d43ccf386 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:25.908875 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-360166f6-4cd0-4a65-a2d3-455d43ccf386 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.166650 May 09 23:06:25.909480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 249/512] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:25 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:25.909634 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6eefe9ea-5fea-4f96-bb77-1277c1d4ec2f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:25.910004 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6eefe9ea-5fea-4f96-bb77-1277c1d4ec2f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:25.917503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6eefe9ea-5fea-4f96-bb77-1277c1d4ec2f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:25.917883 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6eefe9ea-5fea-4f96-bb77-1277c1d4ec2f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:25.918770 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6eefe9ea-5fea-4f96-bb77-1277c1d4ec2f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:25.919205 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6eefe9ea-5fea-4f96-bb77-1277c1d4ec2f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:26.003666 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-4f405441-6fb8-4e67-b7e6-16dba27795c7 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:26.004281 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-4f405441-6fb8-4e67-b7e6-16dba27795c7 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:26.010037 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4f405441-6fb8-4e67-b7e6-16dba27795c7 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:26.010532 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4f405441-6fb8-4e67-b7e6-16dba27795c7 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:26.011297 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4f405441-6fb8-4e67-b7e6-16dba27795c7 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:26.011725 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4f405441-6fb8-4e67-b7e6-16dba27795c7 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:26.138711 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-4f405441-6fb8-4e67-b7e6-16dba27795c7 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:26.139082 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6eefe9ea-5fea-4f96-bb77-1277c1d4ec2f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:26.146483 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-4f405441-6fb8-4e67-b7e6-16dba27795c7 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d" status: 200 len: 1318 microversion: 2.1 time: 0.146687 May 09 23:06:26.148584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 250/513] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:25 2022] GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:26.148717 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6eefe9ea-5fea-4f96-bb77-1277c1d4ec2f tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1735 microversion: 2.1 time: 0.242672 May 09 23:06:26.148717 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 264/514] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:25 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:26.800003 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-de805f0d-cdc6-46f6-9e2c-81262040045d req-8f7e3d79-4b79-4a97-b4d4-7db33a21dd9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ea1b8e-49ff-4716-8cbf-ca11225258aa", "tag": "49e0cd49-aaf5-4ce6-b0b4-5c7345fa279e"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:26.808386 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-de805f0d-cdc6-46f6-9e2c-81262040045d req-8f7e3d79-4b79-4a97-b4d4-7db33a21dd9f service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:26.808831 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-de805f0d-cdc6-46f6-9e2c-81262040045d req-8f7e3d79-4b79-4a97-b4d4-7db33a21dd9f service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:26.822107 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-de805f0d-cdc6-46f6-9e2c-81262040045d req-8f7e3d79-4b79-4a97-b4d4-7db33a21dd9f service nova] Creating event network-changed:49e0cd49-aaf5-4ce6-b0b4-5c7345fa279e for instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa on hv-cinder-84067 May 09 23:06:26.829197 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-de805f0d-cdc6-46f6-9e2c-81262040045d req-8f7e3d79-4b79-4a97-b4d4-7db33a21dd9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033340 May 09 23:06:26.830446 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 251/515] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:06:26.930042 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5636bcb8-5b19-48aa-9787-5d184ce41ce1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:26.931001 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-5636bcb8-5b19-48aa-9787-5d184ce41ce1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:26.938322 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5636bcb8-5b19-48aa-9787-5d184ce41ce1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:26.938775 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5636bcb8-5b19-48aa-9787-5d184ce41ce1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:26.939562 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5636bcb8-5b19-48aa-9787-5d184ce41ce1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:26.940003 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5636bcb8-5b19-48aa-9787-5d184ce41ce1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:27.116983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-5636bcb8-5b19-48aa-9787-5d184ce41ce1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:27.125796 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-5636bcb8-5b19-48aa-9787-5d184ce41ce1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1756 microversion: 2.1 time: 0.203177 May 09 23:06:27.135554 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 265/516] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:26 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:27.164077 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fd9a1b32-1ad9-4022-9ce4-cb8189783555 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:27.164689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0a606869-4b27-4d58-b17a-e19918128068 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:27.164919 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-fd9a1b32-1ad9-4022-9ce4-cb8189783555 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:27.165415 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-0a606869-4b27-4d58-b17a-e19918128068 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:27.170973 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fd9a1b32-1ad9-4022-9ce4-cb8189783555 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:27.171466 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0a606869-4b27-4d58-b17a-e19918128068 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:27.172101 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fd9a1b32-1ad9-4022-9ce4-cb8189783555 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:27.172673 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0a606869-4b27-4d58-b17a-e19918128068 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:27.172964 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fd9a1b32-1ad9-4022-9ce4-cb8189783555 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:27.173401 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fd9a1b32-1ad9-4022-9ce4-cb8189783555 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:27.173517 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0a606869-4b27-4d58-b17a-e19918128068 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:27.173877 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0a606869-4b27-4d58-b17a-e19918128068 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:27.307468 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-fd9a1b32-1ad9-4022-9ce4-cb8189783555 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:27.307647 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-0a606869-4b27-4d58-b17a-e19918128068 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:27.315106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-fd9a1b32-1ad9-4022-9ce4-cb8189783555 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d" status: 200 len: 1507 microversion: 2.1 time: 0.155568 May 09 23:06:27.315650 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-0a606869-4b27-4d58-b17a-e19918128068 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1715 microversion: 2.1 time: 0.154953 May 09 23:06:27.319546 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 252/517] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:27 2022] GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:27.319727 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 266/518] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:27 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:27.339352 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e85605db-1f01-48c6-bec8-65d800cea624 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fb29142-43a7-4100-abe3-f7e6ffc0215f", "device": "/dev/sdb"}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:27.340540 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e85605db-1f01-48c6-bec8-65d800cea624 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:27.347971 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e85605db-1f01-48c6-bec8-65d800cea624 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:27.348424 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e85605db-1f01-48c6-bec8-65d800cea624 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:27.349204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e85605db-1f01-48c6-bec8-65d800cea624 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:27.349642 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e85605db-1f01-48c6-bec8-65d800cea624 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:27.427044 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5caf9233-99df-4491-ae98-16c57e91916d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:27.427544 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-5caf9233-99df-4491-ae98-16c57e91916d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:27.433560 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5caf9233-99df-4491-ae98-16c57e91916d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:27.434099 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5caf9233-99df-4491-ae98-16c57e91916d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:27.434905 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5caf9233-99df-4491-ae98-16c57e91916d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:27.435346 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5caf9233-99df-4491-ae98-16c57e91916d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:27.514069 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-5caf9233-99df-4491-ae98-16c57e91916d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] HTTP exception thrown: Cannot 'detach_volume' instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 while it is in vm_state rescued May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5caf9233-99df-4491-ae98-16c57e91916d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Request method failure captured: May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: DELETE /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-volume_attachments/a6afe6aa-2659-4976-80d6-142dc63f88b0 HTTP/1.1 May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ2FFz9vnmF8wAewdVUSwImcpsQ_FwsT9_7-H0Toz28qyLF5raYcR0RdwhQ7DcuMUUb6fbU3N9fxJ3lqVbGJA-eSv-tQlbFOPaZxX5sJAbjs8F6A88WSsbHqIz7xSQ8sIzcyDrkQNCaIK1p8i0U8DUR4GQ-9BgcmVdUyMXRTEAlwBLw May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 0cb055ff9f0d4af6962070c7a2f19bf3 May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:06:27.516262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:06:27.517764 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:06:27.517764 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:06:27.517764 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 0cb055ff9f0d4af6962070c7a2f19bf3 May 09 23:06:27.517764 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:06:27.517764 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-ServerRescueNegativeTestJSON-345311633-project May 09 23:06:27.517764 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:06:27.517764 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:06:27.517764 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: e41b4feaa9be44e89210b70c19ef10ab May 09 23:06:27.517764 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-ServerRescueNegativeTestJSON-345311633-project May 09 23:06:27.517764 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:06:27.517764 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Cannot 'detach_volume' instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 while it is in vm_state rescued May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'server_id': 'bccbae96-189c-4f1a-8a18-a94e8684d9b6', 'id': 'a6afe6aa-2659-4976-80d6-142dc63f88b0'} May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:06:27.518670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 while it is in vm_state rescued May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 while it is in vm_state rescued May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:27.520139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5caf9233-99df-4491-ae98-16c57e91916d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Returning 409 to user: Cannot 'detach_volume' instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 while it is in vm_state rescued {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:06:27.521368 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-5caf9233-99df-4491-ae98-16c57e91916d tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-volume_attachments/a6afe6aa-2659-4976-80d6-142dc63f88b0" status: 409 len: 152 microversion: 2.1 time: 0.096343 May 09 23:06:27.521368 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 267/519] 10.222.0.23 () {58 vars in 1415 bytes} [Mon May 9 23:06:27 2022] DELETE /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-volume_attachments/a6afe6aa-2659-4976-80d6-142dc63f88b0 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 09 23:06:27.526000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-71626401-b982-4034-8bd2-196065b8e61e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:27.526585 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-71626401-b982-4034-8bd2-196065b8e61e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:27.532996 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-71626401-b982-4034-8bd2-196065b8e61e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:27.533448 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-71626401-b982-4034-8bd2-196065b8e61e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:27.534318 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-71626401-b982-4034-8bd2-196065b8e61e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:27.534757 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-71626401-b982-4034-8bd2-196065b8e61e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:27.613368 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-71626401-b982-4034-8bd2-196065b8e61e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "POST /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/action" status: 202 len: 0 microversion: 2.1 time: 0.090697 May 09 23:06:27.614375 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 268/520] 10.222.0.23 () {60 vars in 1277 bytes} [Mon May 9 23:06:27 2022] POST /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:06:27.624173 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-94aa064b-c5fb-43b3-a0d0-ab26f289a29a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:27.624173 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-94aa064b-c5fb-43b3-a0d0-ab26f289a29a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:27.631826 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-94aa064b-c5fb-43b3-a0d0-ab26f289a29a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:27.632347 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-94aa064b-c5fb-43b3-a0d0-ab26f289a29a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:27.633400 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-94aa064b-c5fb-43b3-a0d0-ab26f289a29a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:27.633835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-94aa064b-c5fb-43b3-a0d0-ab26f289a29a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:27.785185 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-94aa064b-c5fb-43b3-a0d0-ab26f289a29a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:27.794505 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-94aa064b-c5fb-43b3-a0d0-ab26f289a29a tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1723 microversion: 2.1 time: 0.175740 May 09 23:06:27.795095 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 269/521] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:27 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:28.057441 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e85605db-1f01-48c6-bec8-65d800cea624 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "POST /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.724357 May 09 23:06:28.058232 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 253/522] 10.222.0.23 () {60 vars in 1322 bytes} [Mon May 9 23:06:27 2022] POST /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d/os-volume_attachments => generated 194 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:06:28.143565 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-895fe4cb-2408-4450-af68-4e1f75190740 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:28.144187 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-895fe4cb-2408-4450-af68-4e1f75190740 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:28.150457 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-895fe4cb-2408-4450-af68-4e1f75190740 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:28.150909 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-895fe4cb-2408-4450-af68-4e1f75190740 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:28.152260 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-895fe4cb-2408-4450-af68-4e1f75190740 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:28.152918 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-895fe4cb-2408-4450-af68-4e1f75190740 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:28.292985 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-895fe4cb-2408-4450-af68-4e1f75190740 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:28.301150 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-895fe4cb-2408-4450-af68-4e1f75190740 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1759 microversion: 2.1 time: 0.161980 May 09 23:06:28.301715 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 270/523] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:28 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:28.812976 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e6dfa133-626d-4a57-bd77-9fa84585e565 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:28.813701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e6dfa133-626d-4a57-bd77-9fa84585e565 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:28.819938 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e6dfa133-626d-4a57-bd77-9fa84585e565 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:28.820384 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e6dfa133-626d-4a57-bd77-9fa84585e565 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:28.821193 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e6dfa133-626d-4a57-bd77-9fa84585e565 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:28.821646 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e6dfa133-626d-4a57-bd77-9fa84585e565 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:28.963136 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e6dfa133-626d-4a57-bd77-9fa84585e565 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:28.971659 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e6dfa133-626d-4a57-bd77-9fa84585e565 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1723 microversion: 2.1 time: 0.163411 May 09 23:06:28.972267 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 254/524] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:28 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:29.990763 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-46d30bbd-6150-4e12-adce-634409a17bbe tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:29.991309 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-46d30bbd-6150-4e12-adce-634409a17bbe tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:29.997544 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-46d30bbd-6150-4e12-adce-634409a17bbe tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:29.997992 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-46d30bbd-6150-4e12-adce-634409a17bbe tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:29.998787 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-46d30bbd-6150-4e12-adce-634409a17bbe tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:29.999220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-46d30bbd-6150-4e12-adce-634409a17bbe tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:30.128074 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-46d30bbd-6150-4e12-adce-634409a17bbe tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:30.135864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-46d30bbd-6150-4e12-adce-634409a17bbe tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1723 microversion: 2.1 time: 0.149028 May 09 23:06:30.136441 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 271/525] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:29 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:06:31.153238 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cd9a9f62-54b4-428c-83df-cf3f5f731839 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:31.153868 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cd9a9f62-54b4-428c-83df-cf3f5f731839 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:31.160300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd9a9f62-54b4-428c-83df-cf3f5f731839 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:31.160741 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd9a9f62-54b4-428c-83df-cf3f5f731839 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:31.161503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd9a9f62-54b4-428c-83df-cf3f5f731839 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:31.161933 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cd9a9f62-54b4-428c-83df-cf3f5f731839 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:31.286975 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cd9a9f62-54b4-428c-83df-cf3f5f731839 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:31.294641 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cd9a9f62-54b4-428c-83df-cf3f5f731839 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1723 microversion: 2.1 time: 0.145235 May 09 23:06:31.295215 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 255/526] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:31 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:32.311686 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-21b54a31-cc36-48da-a675-c6398571f4b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:32.312962 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-21b54a31-cc36-48da-a675-c6398571f4b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:32.319132 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-21b54a31-cc36-48da-a675-c6398571f4b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:32.319576 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-21b54a31-cc36-48da-a675-c6398571f4b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:32.320332 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-21b54a31-cc36-48da-a675-c6398571f4b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:32.320765 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-21b54a31-cc36-48da-a675-c6398571f4b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:32.458458 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-21b54a31-cc36-48da-a675-c6398571f4b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:32.466107 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-21b54a31-cc36-48da-a675-c6398571f4b0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1729 microversion: 2.1 time: 0.158309 May 09 23:06:32.466697 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 272/527] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:32 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:32.482963 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c2369da1-66ad-49ef-9566-3c42a592dc70 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:32.483456 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c2369da1-66ad-49ef-9566-3c42a592dc70 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:32.490265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c2369da1-66ad-49ef-9566-3c42a592dc70 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:32.490711 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c2369da1-66ad-49ef-9566-3c42a592dc70 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:32.491466 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c2369da1-66ad-49ef-9566-3c42a592dc70 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:32.491895 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c2369da1-66ad-49ef-9566-3c42a592dc70 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:32.567646 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c2369da1-66ad-49ef-9566-3c42a592dc70 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088602 May 09 23:06:32.568246 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 256/528] 10.222.0.23 () {58 vars in 1274 bytes} [Mon May 9 23:06:32 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:06:33.699394 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-dbbe91f6-28f3-4d0a-90c4-c34120448299 req-53fc18b3-389b-434c-8dfc-e523a40a28c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bccbae96-189c-4f1a-8a18-a94e8684d9b6", "tag": "f4111c9d-b7d8-4877-85f0-8a4596bfc164"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:33.708590 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-dbbe91f6-28f3-4d0a-90c4-c34120448299 req-53fc18b3-389b-434c-8dfc-e523a40a28c8 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:33.709273 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-dbbe91f6-28f3-4d0a-90c4-c34120448299 req-53fc18b3-389b-434c-8dfc-e523a40a28c8 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:33.722973 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-dbbe91f6-28f3-4d0a-90c4-c34120448299 req-53fc18b3-389b-434c-8dfc-e523a40a28c8 service nova] Creating event network-changed:f4111c9d-b7d8-4877-85f0-8a4596bfc164 for instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 on hv-cinder-84067 May 09 23:06:33.728347 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-dbbe91f6-28f3-4d0a-90c4-c34120448299 req-53fc18b3-389b-434c-8dfc-e523a40a28c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032490 May 09 23:06:33.729136 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 273/529] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:06:35.743323 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-6d0e3daa-d6c1-4c3d-b043-945dbbe5c1e6 req-4de2751f-6618-4288-8aac-bc985de537e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bccbae96-189c-4f1a-8a18-a94e8684d9b6", "tag": "f4111c9d-b7d8-4877-85f0-8a4596bfc164"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:35.751245 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-6d0e3daa-d6c1-4c3d-b043-945dbbe5c1e6 req-4de2751f-6618-4288-8aac-bc985de537e7 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:35.751688 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-6d0e3daa-d6c1-4c3d-b043-945dbbe5c1e6 req-4de2751f-6618-4288-8aac-bc985de537e7 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:35.762469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-6d0e3daa-d6c1-4c3d-b043-945dbbe5c1e6 req-4de2751f-6618-4288-8aac-bc985de537e7 service nova] Creating event network-changed:f4111c9d-b7d8-4877-85f0-8a4596bfc164 for instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 on hv-cinder-84067 May 09 23:06:35.767890 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-6d0e3daa-d6c1-4c3d-b043-945dbbe5c1e6 req-4de2751f-6618-4288-8aac-bc985de537e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028649 May 09 23:06:35.768461 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 257/530] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:06:47.314598 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0b37e679-a4d2-4a5b-8b1c-2aceadf6d685 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:47.315175 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-0b37e679-a4d2-4a5b-8b1c-2aceadf6d685 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:47.321137 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0b37e679-a4d2-4a5b-8b1c-2aceadf6d685 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:47.321587 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0b37e679-a4d2-4a5b-8b1c-2aceadf6d685 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:47.322412 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0b37e679-a4d2-4a5b-8b1c-2aceadf6d685 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:47.322850 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0b37e679-a4d2-4a5b-8b1c-2aceadf6d685 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:47.399302 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.objects.instance [None req-0b37e679-a4d2-4a5b-8b1c-2aceadf6d685 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lazy-loading 'services' on Instance uuid fbf9ab5d-6496-440d-8d1c-7e83d1d7386d {{(pid=117143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:06:47.465941 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-0b37e679-a4d2-4a5b-8b1c-2aceadf6d685 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d/os-volume_attachments/4fb29142-43a7-4100-abe3-f7e6ffc0215f" status: 202 len: 0 microversion: 2.1 time: 0.156214 May 09 23:06:47.466579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 274/531] 10.222.0.23 () {58 vars in 1415 bytes} [Mon May 9 23:06:47 2022] DELETE /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d/os-volume_attachments/4fb29142-43a7-4100-abe3-f7e6ffc0215f => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:06:48.583111 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-12a18b5d-4180-4ec5-9288-a4b2ee526355 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:48.583692 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-12a18b5d-4180-4ec5-9288-a4b2ee526355 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:48.589624 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-12a18b5d-4180-4ec5-9288-a4b2ee526355 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:48.590065 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-12a18b5d-4180-4ec5-9288-a4b2ee526355 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:48.590866 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-12a18b5d-4180-4ec5-9288-a4b2ee526355 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:48.591291 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-12a18b5d-4180-4ec5-9288-a4b2ee526355 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:48.615434 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-12a18b5d-4180-4ec5-9288-a4b2ee526355 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Going to try to terminate instance {{(pid=117142) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:06:48.685586 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-12a18b5d-4180-4ec5-9288-a4b2ee526355 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d" status: 204 len: 0 microversion: 2.1 time: 0.106899 May 09 23:06:48.686428 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 258/532] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:06:48 2022] DELETE /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:06:48.695792 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c7d369d0-3132-4ed5-a898-0630d7b77199 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:48.696591 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c7d369d0-3132-4ed5-a898-0630d7b77199 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:48.703150 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c7d369d0-3132-4ed5-a898-0630d7b77199 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:48.703607 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c7d369d0-3132-4ed5-a898-0630d7b77199 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:48.704383 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c7d369d0-3132-4ed5-a898-0630d7b77199 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:48.704814 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c7d369d0-3132-4ed5-a898-0630d7b77199 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:48.833643 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c7d369d0-3132-4ed5-a898-0630d7b77199 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:48.840855 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c7d369d0-3132-4ed5-a898-0630d7b77199 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d" status: 200 len: 1513 microversion: 2.1 time: 0.149487 May 09 23:06:48.841432 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 275/533] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:48 2022] GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:49.859845 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-b64f469d-936f-48b6-8dda-ed81ff12e8fc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:49.860755 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-b64f469d-936f-48b6-8dda-ed81ff12e8fc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:49.867024 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b64f469d-936f-48b6-8dda-ed81ff12e8fc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:49.867475 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b64f469d-936f-48b6-8dda-ed81ff12e8fc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:49.868244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b64f469d-936f-48b6-8dda-ed81ff12e8fc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:49.868681 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b64f469d-936f-48b6-8dda-ed81ff12e8fc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:49.996605 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-b64f469d-936f-48b6-8dda-ed81ff12e8fc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:50.003994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-b64f469d-936f-48b6-8dda-ed81ff12e8fc tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d" status: 200 len: 1513 microversion: 2.1 time: 0.149174 May 09 23:06:50.004572 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 259/534] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:49 2022] GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:51.021286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f92f3cfc-c065-4593-ba0b-10c9b9bf7e7e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:51.021936 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f92f3cfc-c065-4593-ba0b-10c9b9bf7e7e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:51.028186 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f92f3cfc-c065-4593-ba0b-10c9b9bf7e7e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:51.028637 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f92f3cfc-c065-4593-ba0b-10c9b9bf7e7e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:51.029403 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f92f3cfc-c065-4593-ba0b-10c9b9bf7e7e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:51.029834 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f92f3cfc-c065-4593-ba0b-10c9b9bf7e7e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:51.119653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f92f3cfc-c065-4593-ba0b-10c9b9bf7e7e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3e164b111b4c3784b220ef483bb5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a54785a57d74beb87b5a31f928583e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:06:51.127871 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f92f3cfc-c065-4593-ba0b-10c9b9bf7e7e tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d" status: 200 len: 1471 microversion: 2.1 time: 0.110364 May 09 23:06:51.128456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 276/535] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:51 2022] GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d => generated 1471 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:06:51.154166 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-c2a7f34e-7487-4288-90e0-cbc06947212f req-7f2a922f-7e93-48f9-b355-f4460a43b43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf9ab5d-6496-440d-8d1c-7e83d1d7386d", "name": "network-vif-deleted", "tag": "dbdbce6a-9c78-4254-8fbd-830828ffb663"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:06:51.162451 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-c2a7f34e-7487-4288-90e0-cbc06947212f req-7f2a922f-7e93-48f9-b355-f4460a43b43d service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:51.162890 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-c2a7f34e-7487-4288-90e0-cbc06947212f req-7f2a922f-7e93-48f9-b355-f4460a43b43d service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:51.174455 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-c2a7f34e-7487-4288-90e0-cbc06947212f req-7f2a922f-7e93-48f9-b355-f4460a43b43d service nova] Creating event network-vif-deleted:dbdbce6a-9c78-4254-8fbd-830828ffb663 for instance fbf9ab5d-6496-440d-8d1c-7e83d1d7386d on hv-cinder-84067 May 09 23:06:51.179358 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-c2a7f34e-7487-4288-90e0-cbc06947212f req-7f2a922f-7e93-48f9-b355-f4460a43b43d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028991 May 09 23:06:51.179954 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 260/536] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:06:52.145869 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d83d4c14-b428-4349-9ba9-d3839b7e3dd1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:52.146504 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d83d4c14-b428-4349-9ba9-d3839b7e3dd1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] [instance: fbf9ab5d-6496-440d-8d1c-7e83d1d7386d] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:52.152870 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d83d4c14-b428-4349-9ba9-d3839b7e3dd1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:52.153317 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d83d4c14-b428-4349-9ba9-d3839b7e3dd1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:52.154077 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d83d4c14-b428-4349-9ba9-d3839b7e3dd1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:52.154567 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d83d4c14-b428-4349-9ba9-d3839b7e3dd1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:52.167796 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-d83d4c14-b428-4349-9ba9-d3839b7e3dd1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] HTTP exception thrown: Instance fbf9ab5d-6496-440d-8d1c-7e83d1d7386d could not be found. May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d83d4c14-b428-4349-9ba9-d3839b7e3dd1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Request method failure captured: May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d HTTP/1.1 May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ4aasGiSwdN1vj93RhIKZbh5cZtf3P9r_OSIjobIb9vHGw52Gec_qLAGux49pMf3jazy9cHLgQwMm_zOD6Qln6wbQJ4su7tFEyroRS2F9UQjqQhivhF3CNEzMM6_fh_WW2vAh9ff3RkPPikTZXLuUU_8n8yOKiSeT3Ih0wx2Lsj5d8 May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 9a54785a57d74beb87b5a31f928583e7 May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-VolumesSnapshotTestJSON-361051361 May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:06:52.169392 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:06:52.170910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9a54785a57d74beb87b5a31f928583e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9a54785a57d74beb87b5a31f928583e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9a54785a57d74beb87b5a31f928583e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9a54785a57d74beb87b5a31f928583e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:06:52.170910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-VolumesSnapshotTestJSON-361051361 May 09 23:06:52.170910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 9a54785a57d74beb87b5a31f928583e7 May 09 23:06:52.170910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-361051361 May 09 23:06:52.170910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-VolumesSnapshotTestJSON-361051361-project May 09 23:06:52.170910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:06:52.170910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:06:52.170910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 7d3e164b111b4c3784b220ef483bb5b9 May 09 23:06:52.170910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-VolumesSnapshotTestJSON-361051361-project May 09 23:06:52.170910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:06:52.170910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance fbf9ab5d-6496-440d-8d1c-7e83d1d7386d could not be found. May 09 23:06:52.170910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': 'fbf9ab5d-6496-440d-8d1c-7e83d1d7386d'} May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf9ab5d-6496-440d-8d1c-7e83d1d7386d could not be found. May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:06:52.171691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf9ab5d-6496-440d-8d1c-7e83d1d7386d could not be found. May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf9ab5d-6496-440d-8d1c-7e83d1d7386d could not be found. May 09 23:06:52.173548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:06:52.174648 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d83d4c14-b428-4349-9ba9-d3839b7e3dd1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] Returning 404 to user: Instance fbf9ab5d-6496-440d-8d1c-7e83d1d7386d could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:06:52.174648 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d83d4c14-b428-4349-9ba9-d3839b7e3dd1 tempest-VolumesSnapshotTestJSON-361051361 tempest-VolumesSnapshotTestJSON-361051361-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d" status: 404 len: 111 microversion: 2.1 time: 0.028811 May 09 23:06:52.174648 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 277/537] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:06:52 2022] GET /compute/v2.1/servers/fbf9ab5d-6496-440d-8d1c-7e83d1d7386d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:06:59.091680 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0482bf58-589c-4d74-a687-52e6f9fed5e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:59.092262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-0482bf58-589c-4d74-a687-52e6f9fed5e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:59.099026 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0482bf58-589c-4d74-a687-52e6f9fed5e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:59.099464 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0482bf58-589c-4d74-a687-52e6f9fed5e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:59.100221 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0482bf58-589c-4d74-a687-52e6f9fed5e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:59.100647 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0482bf58-589c-4d74-a687-52e6f9fed5e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:59.128045 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0482bf58-589c-4d74-a687-52e6f9fed5e6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/os-volume_attachments/81919e77-dc91-4581-8fa8-3b5c46c1a528" status: 200 len: 194 microversion: 2.20 time: 0.041061 May 09 23:06:59.128628 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 261/538] 10.222.0.23 () {60 vars in 1453 bytes} [Mon May 9 23:06:59 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/os-volume_attachments/81919e77-dc91-4581-8fa8-3b5c46c1a528 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 23:06:59.188787 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-624b8c9a-7b72-4967-9698-b6bf33b7ed3f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:59.189285 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-624b8c9a-7b72-4967-9698-b6bf33b7ed3f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:59.195769 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-624b8c9a-7b72-4967-9698-b6bf33b7ed3f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:59.196420 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-624b8c9a-7b72-4967-9698-b6bf33b7ed3f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:59.197191 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-624b8c9a-7b72-4967-9698-b6bf33b7ed3f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:59.197630 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-624b8c9a-7b72-4967-9698-b6bf33b7ed3f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:59.276582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.objects.instance [None req-624b8c9a-7b72-4967-9698-b6bf33b7ed3f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lazy-loading 'services' on Instance uuid 2e5734d5-da65-4ee8-8684-e236f56da50a {{(pid=117143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:06:59.348218 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-624b8c9a-7b72-4967-9698-b6bf33b7ed3f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/os-volume_attachments/81919e77-dc91-4581-8fa8-3b5c46c1a528" status: 202 len: 0 microversion: 2.20 time: 0.163496 May 09 23:06:59.348804 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 278/539] 10.222.0.23 () {60 vars in 1456 bytes} [Mon May 9 23:06:59 2022] DELETE /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/os-volume_attachments/81919e77-dc91-4581-8fa8-3b5c46c1a528 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 23:06:59.357472 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-96e49eca-2c31-4da6-af07-5a2b0617dcd4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:06:59.358429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-96e49eca-2c31-4da6-af07-5a2b0617dcd4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:06:59.364460 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-96e49eca-2c31-4da6-af07-5a2b0617dcd4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:59.365010 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-96e49eca-2c31-4da6-af07-5a2b0617dcd4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:59.365862 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-96e49eca-2c31-4da6-af07-5a2b0617dcd4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:06:59.366401 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-96e49eca-2c31-4da6-af07-5a2b0617dcd4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:06:59.404209 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-96e49eca-2c31-4da6-af07-5a2b0617dcd4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050948 May 09 23:06:59.405104 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 262/540] 10.222.0.23 () {60 vars in 1342 bytes} [Mon May 9 23:06:59 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 23:07:00.416607 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-273d2565-c599-4573-9955-12a1e72ddef2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:00.417729 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-273d2565-c599-4573-9955-12a1e72ddef2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:00.424340 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-273d2565-c599-4573-9955-12a1e72ddef2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:00.424790 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-273d2565-c599-4573-9955-12a1e72ddef2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:00.425575 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-273d2565-c599-4573-9955-12a1e72ddef2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:00.426010 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-273d2565-c599-4573-9955-12a1e72ddef2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:00.453080 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-273d2565-c599-4573-9955-12a1e72ddef2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040819 May 09 23:07:00.454170 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 279/541] 10.222.0.23 () {60 vars in 1342 bytes} [Mon May 9 23:07:00 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:00.510182 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ef158b10-dbcd-434a-9974-c5d3c8d56b89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:00.510691 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ef158b10-dbcd-434a-9974-c5d3c8d56b89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:00.517544 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ef158b10-dbcd-434a-9974-c5d3c8d56b89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:00.517996 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ef158b10-dbcd-434a-9974-c5d3c8d56b89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:00.518799 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ef158b10-dbcd-434a-9974-c5d3c8d56b89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:00.519235 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ef158b10-dbcd-434a-9974-c5d3c8d56b89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:00.544414 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ef158b10-dbcd-434a-9974-c5d3c8d56b89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Going to try to terminate instance {{(pid=117142) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:07:00.625501 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ef158b10-dbcd-434a-9974-c5d3c8d56b89 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 204 len: 0 microversion: 2.20 time: 0.118804 May 09 23:07:00.626089 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 263/542] 10.222.0.23 () {60 vars in 1279 bytes} [Mon May 9 23:07:00 2022] DELETE /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 09 23:07:00.639823 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-4eed46f9-9661-4858-8ed6-9dff073057c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:00.640457 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-4eed46f9-9661-4858-8ed6-9dff073057c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:00.650440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4eed46f9-9661-4858-8ed6-9dff073057c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:00.650440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4eed46f9-9661-4858-8ed6-9dff073057c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:00.650440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4eed46f9-9661-4858-8ed6-9dff073057c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:00.650440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4eed46f9-9661-4858-8ed6-9dff073057c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:00.780254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4eed46f9-9661-4858-8ed6-9dff073057c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:00.788547 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4eed46f9-9661-4858-8ed6-9dff073057c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:00.790033 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4eed46f9-9661-4858-8ed6-9dff073057c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:00.791197 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-4eed46f9-9661-4858-8ed6-9dff073057c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.160385 May 09 23:07:00.791753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 280/543] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:00 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:07:01.809238 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-eacf93ff-f9d4-4e35-9fbd-548a72b767ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:01.809933 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-eacf93ff-f9d4-4e35-9fbd-548a72b767ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:01.816416 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eacf93ff-f9d4-4e35-9fbd-548a72b767ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:01.816871 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eacf93ff-f9d4-4e35-9fbd-548a72b767ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:01.817634 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eacf93ff-f9d4-4e35-9fbd-548a72b767ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:01.818071 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eacf93ff-f9d4-4e35-9fbd-548a72b767ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:01.954948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-eacf93ff-f9d4-4e35-9fbd-548a72b767ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:01.962624 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-eacf93ff-f9d4-4e35-9fbd-548a72b767ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:01.964114 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-eacf93ff-f9d4-4e35-9fbd-548a72b767ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:01.965252 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-eacf93ff-f9d4-4e35-9fbd-548a72b767ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.160282 May 09 23:07:01.965816 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 264/544] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:01 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:07:02.984106 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1bca3b8d-5771-48fd-9d38-b1292cb345ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:02.984643 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1bca3b8d-5771-48fd-9d38-b1292cb345ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:02.991549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1bca3b8d-5771-48fd-9d38-b1292cb345ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:02.992000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1bca3b8d-5771-48fd-9d38-b1292cb345ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:02.992787 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1bca3b8d-5771-48fd-9d38-b1292cb345ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:02.993208 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1bca3b8d-5771-48fd-9d38-b1292cb345ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:03.120987 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1bca3b8d-5771-48fd-9d38-b1292cb345ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:03.130328 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1bca3b8d-5771-48fd-9d38-b1292cb345ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:03.132133 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1bca3b8d-5771-48fd-9d38-b1292cb345ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:03.133920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1bca3b8d-5771-48fd-9d38-b1292cb345ed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.154012 May 09 23:07:03.134522 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 281/545] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:02 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:07:04.151332 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-3d7d3c66-e454-42d2-a527-48f01f57b506 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:04.151935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-3d7d3c66-e454-42d2-a527-48f01f57b506 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:04.159177 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3d7d3c66-e454-42d2-a527-48f01f57b506 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:04.159627 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3d7d3c66-e454-42d2-a527-48f01f57b506 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:04.160405 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3d7d3c66-e454-42d2-a527-48f01f57b506 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:04.160845 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3d7d3c66-e454-42d2-a527-48f01f57b506 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:04.286612 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-3d7d3c66-e454-42d2-a527-48f01f57b506 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:04.296611 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-3d7d3c66-e454-42d2-a527-48f01f57b506 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:04.297861 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-3d7d3c66-e454-42d2-a527-48f01f57b506 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:04.299037 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-3d7d3c66-e454-42d2-a527-48f01f57b506 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1723 microversion: 2.20 time: 0.151602 May 09 23:07:04.299599 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 265/546] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:04 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:07:04.977756 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-8844349b-c374-4b3b-b7e7-0645d146380b req-1cc072a9-1f6b-4f34-a28a-eabcbd3a96ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5734d5-da65-4ee8-8684-e236f56da50a", "name": "network-vif-deleted", "tag": "9b2aff87-eeca-44a4-b616-becbcd5f1d58"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:04.986054 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-8844349b-c374-4b3b-b7e7-0645d146380b req-1cc072a9-1f6b-4f34-a28a-eabcbd3a96ae service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:04.986587 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-8844349b-c374-4b3b-b7e7-0645d146380b req-1cc072a9-1f6b-4f34-a28a-eabcbd3a96ae service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:04.997716 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-8844349b-c374-4b3b-b7e7-0645d146380b req-1cc072a9-1f6b-4f34-a28a-eabcbd3a96ae service nova] Creating event network-vif-deleted:9b2aff87-eeca-44a4-b616-becbcd5f1d58 for instance 2e5734d5-da65-4ee8-8684-e236f56da50a on hv-cinder-84067 May 09 23:07:05.002980 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-8844349b-c374-4b3b-b7e7-0645d146380b req-1cc072a9-1f6b-4f34-a28a-eabcbd3a96ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029020 May 09 23:07:05.003606 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 282/547] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:05.317087 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-bcc3e2e3-63eb-4034-8905-7b3bc8b5697b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:05.318355 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-bcc3e2e3-63eb-4034-8905-7b3bc8b5697b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:05.324545 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bcc3e2e3-63eb-4034-8905-7b3bc8b5697b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:05.325001 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bcc3e2e3-63eb-4034-8905-7b3bc8b5697b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:05.325775 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bcc3e2e3-63eb-4034-8905-7b3bc8b5697b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:05.326237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bcc3e2e3-63eb-4034-8905-7b3bc8b5697b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:05.356797 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bcc3e2e3-63eb-4034-8905-7b3bc8b5697b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:05.357248 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bcc3e2e3-63eb-4034-8905-7b3bc8b5697b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:05.357702 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-bcc3e2e3-63eb-4034-8905-7b3bc8b5697b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lazy-loading 'fault' on Instance uuid 2e5734d5-da65-4ee8-8684-e236f56da50a {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:07:05.403823 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-bcc3e2e3-63eb-4034-8905-7b3bc8b5697b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:05.413405 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-bcc3e2e3-63eb-4034-8905-7b3bc8b5697b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:05.415083 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-bcc3e2e3-63eb-4034-8905-7b3bc8b5697b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:05.416265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-bcc3e2e3-63eb-4034-8905-7b3bc8b5697b tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 200 len: 1370 microversion: 2.20 time: 0.103254 May 09 23:07:05.417124 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 266/548] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:05 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:07:06.436384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-160118e1-f7b1-4745-9a1e-1b517a68e3d8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:06.436995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-160118e1-f7b1-4745-9a1e-1b517a68e3d8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:06.442935 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-160118e1-f7b1-4745-9a1e-1b517a68e3d8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:06.443385 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-160118e1-f7b1-4745-9a1e-1b517a68e3d8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:06.444152 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-160118e1-f7b1-4745-9a1e-1b517a68e3d8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:06.444590 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-160118e1-f7b1-4745-9a1e-1b517a68e3d8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:06.459623 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-160118e1-f7b1-4745-9a1e-1b517a68e3d8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] HTTP exception thrown: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-160118e1-f7b1-4745-9a1e-1b517a68e3d8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Request method failure captured: May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a HTTP/1.1 May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ3QSZIIwAQl8gt77Y_FqFeGc70vpcHEVvAEzfY76g2s1KHzoep_X28Anb8N4KwEGcWkOPHZLR3inQgWrQ1PchRQks70K9fr8apUDLJoRSZrBXunCwCdhEDMFqssiBL72_qeOpkUOV7Mimkf-GO7YOoyKXPh-MRwaKBfvBYTGpEn4hY May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Openstack-Nova-Api-Version: 2.20 May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 0f38af4b388e49958aa17250c181b203 May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:07:06.461206 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:07:06.462864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0f38af4b388e49958aa17250c181b203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0f38af4b388e49958aa17250c181b203"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f38af4b388e49958aa17250c181b203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f38af4b388e49958aa17250c181b203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:07:06.462864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:07:06.462864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 0f38af4b388e49958aa17250c181b203 May 09 23:07:06.462864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:07:06.462864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-AttachVolumeShelveTestJSON-1248822270-project May 09 23:07:06.462864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:07:06.462864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:07:06.462864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: c950754974d748519118d974492f15ce May 09 23:07:06.462864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1248822270-project May 09 23:07:06.462864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:07:06.462864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:07:06.462864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': '2e5734d5-da65-4ee8-8684-e236f56da50a'} May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:07:06.463778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:07:06.465118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:06.466437 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-160118e1-f7b1-4745-9a1e-1b517a68e3d8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Returning 404 to user: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:07:06.466437 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-160118e1-f7b1-4745-9a1e-1b517a68e3d8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 404 len: 111 microversion: 2.20 time: 0.030943 May 09 23:07:06.466437 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 283/549] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:06 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 23:07:06.472478 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c70c4270-3915-4dc9-a69a-d5b9e92e07ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '.version_select at 0x7fc28bb3c5e0>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:06.489802 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c70c4270-3915-4dc9-a69a-d5b9e92e07ad tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-545634904" status: 204 len: 0 microversion: 2.20 time: 0.021924 May 09 23:07:06.490445 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 267/550] 10.222.0.23 () {60 vars in 1258 bytes} [Mon May 9 23:07:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-545634904 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 23:07:07.125150 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a91d9de5-fa64-41fe-8b1c-3da889899c1e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Action: 'create', calling method: .version_select at 0x7fc2981c0790>, body: {"keypair": {"name": "tempest-keypair-104094240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB9yZl2pv3lsx8azPGAyp4+w746SB/1oPucNXNnSEoYBbgkLUtq3X4ypCHpqDKQek6zZXSXEncyp1pWg7m7JK3dGTLJifXiO84H075zyGoC+i4jwnrv93n/DOxwSpastw=="}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:07.139308 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-a91d9de5-fa64-41fe-8b1c-3da889899c1e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Getting quotas for project 0f38af4b388e49958aa17250c181b203. Resources: {'key_pairs'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:07:07.143645 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-a91d9de5-fa64-41fe-8b1c-3da889899c1e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Getting quotas for user c950754974d748519118d974492f15ce and project 0f38af4b388e49958aa17250c181b203. Resources: {'key_pairs'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:07:07.165086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a91d9de5-fa64-41fe-8b1c-3da889899c1e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047058 May 09 23:07:07.165684 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 284/551] 10.222.0.23 () {62 vars in 1199 bytes} [Mon May 9 23:07:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 09 23:07:08.403069 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-673116282", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "741b3e88-dd66-49da-aaee-2d7e838ad44c"}], "security_groups": [{"name": "tempest-securitygroup--387243881"}], "key_name": "tempest-keypair-104094240", "user_data": "}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:08.504512 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.network.neutron [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] validate_networks() for [('741b3e88-dd66-49da-aaee-2d7e838ad44c', None, None, None, None, None)] {{(pid=117142) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:07:08.873091 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Flavor limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:07:08.873518 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Image limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:07:08.873996 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Flavor pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:07:08.874442 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Image pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:07:08.874856 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:07:08.883363 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:08.883810 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:08.884619 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:08.885061 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:08.901451 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Getting quotas for project 0f38af4b388e49958aa17250c181b203. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:07:08.905347 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Getting quotas for user c950754974d748519118d974492f15ce and project 0f38af4b388e49958aa17250c181b203. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:07:08.916659 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Going to run 1 instances... {{(pid=117142) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:07:08.919003 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:07:08.963186 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-83d31ab2-4b5c-49d8-8480-e8c5ebafc0a3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.564863 May 09 23:07:08.963833 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 268/552] 10.222.0.23 () {62 vars in 1187 bytes} [Mon May 9 23:07:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 09 23:07:08.974530 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f0970a6b-7f07-4104-aede-1580026019b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:08.975136 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f0970a6b-7f07-4104-aede-1580026019b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:09.029174 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f0970a6b-7f07-4104-aede-1580026019b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:09.037773 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f0970a6b-7f07-4104-aede-1580026019b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:09.039308 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f0970a6b-7f07-4104-aede-1580026019b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:09.040404 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f0970a6b-7f07-4104-aede-1580026019b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1280 microversion: 2.20 time: 0.069803 May 09 23:07:09.041149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 285/553] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:08 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:07:10.059102 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-4dc6758d-f374-4a15-8d7e-b4a6ca96db9c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:10.059866 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-4dc6758d-f374-4a15-8d7e-b4a6ca96db9c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:10.066426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4dc6758d-f374-4a15-8d7e-b4a6ca96db9c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:10.066884 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4dc6758d-f374-4a15-8d7e-b4a6ca96db9c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:10.067668 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4dc6758d-f374-4a15-8d7e-b4a6ca96db9c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:10.068110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4dc6758d-f374-4a15-8d7e-b4a6ca96db9c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:10.131223 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-4dc6758d-f374-4a15-8d7e-b4a6ca96db9c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:10.139370 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-4dc6758d-f374-4a15-8d7e-b4a6ca96db9c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:10.141389 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-4dc6758d-f374-4a15-8d7e-b4a6ca96db9c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:10.142530 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-4dc6758d-f374-4a15-8d7e-b4a6ca96db9c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1338 microversion: 2.20 time: 0.088086 May 09 23:07:10.143099 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 269/554] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:10 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1338 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:07:11.161069 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-9c98f9a6-8fed-4a79-afdd-96d49ce84e6d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:11.162314 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-9c98f9a6-8fed-4a79-afdd-96d49ce84e6d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:11.168540 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9c98f9a6-8fed-4a79-afdd-96d49ce84e6d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:11.168985 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9c98f9a6-8fed-4a79-afdd-96d49ce84e6d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:11.170004 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9c98f9a6-8fed-4a79-afdd-96d49ce84e6d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:11.170191 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9c98f9a6-8fed-4a79-afdd-96d49ce84e6d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:11.260634 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-1d604c96-4acf-49bb-b0a6-f6265e265f07 req-b0457d84-35b2-4495-90d9-3c9467dd091a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cdc1269-4f55-47ba-8ebc-a403362e1962", "tag": "a898f67f-017d-433f-9c0f-e6793182e363"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:11.270367 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-1d604c96-4acf-49bb-b0a6-f6265e265f07 req-b0457d84-35b2-4495-90d9-3c9467dd091a service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:11.270814 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-1d604c96-4acf-49bb-b0a6-f6265e265f07 req-b0457d84-35b2-4495-90d9-3c9467dd091a service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:11.292430 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-1d604c96-4acf-49bb-b0a6-f6265e265f07 req-b0457d84-35b2-4495-90d9-3c9467dd091a service nova] Creating event network-changed:a898f67f-017d-433f-9c0f-e6793182e363 for instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 on hv-cinder-84067 May 09 23:07:11.300182 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-1d604c96-4acf-49bb-b0a6-f6265e265f07 req-b0457d84-35b2-4495-90d9-3c9467dd091a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043669 May 09 23:07:11.301229 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 270/555] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:07:11.408270 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-9c98f9a6-8fed-4a79-afdd-96d49ce84e6d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:11.416162 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-9c98f9a6-8fed-4a79-afdd-96d49ce84e6d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:11.417694 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-9c98f9a6-8fed-4a79-afdd-96d49ce84e6d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:11.418826 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-9c98f9a6-8fed-4a79-afdd-96d49ce84e6d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1405 microversion: 2.20 time: 0.262210 May 09 23:07:11.419397 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 286/556] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:11 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1405 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:07:12.437482 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-eadc3605-96d8-4e46-ac55-9029f5fbb3e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:12.438761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-eadc3605-96d8-4e46-ac55-9029f5fbb3e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:12.445173 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eadc3605-96d8-4e46-ac55-9029f5fbb3e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:12.445614 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eadc3605-96d8-4e46-ac55-9029f5fbb3e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:12.446395 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eadc3605-96d8-4e46-ac55-9029f5fbb3e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:12.446823 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eadc3605-96d8-4e46-ac55-9029f5fbb3e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:12.577137 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-eadc3605-96d8-4e46-ac55-9029f5fbb3e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:12.585346 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-eadc3605-96d8-4e46-ac55-9029f5fbb3e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:12.586874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-eadc3605-96d8-4e46-ac55-9029f5fbb3e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:12.587978 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-eadc3605-96d8-4e46-ac55-9029f5fbb3e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1405 microversion: 2.20 time: 0.154708 May 09 23:07:12.588532 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 271/557] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:12 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:07:13.606650 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a3d513d2-d86a-4784-b54b-e8d603670ecf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:13.607258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a3d513d2-d86a-4784-b54b-e8d603670ecf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:13.613450 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a3d513d2-d86a-4784-b54b-e8d603670ecf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:13.613899 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a3d513d2-d86a-4784-b54b-e8d603670ecf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:13.614778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a3d513d2-d86a-4784-b54b-e8d603670ecf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:13.615205 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a3d513d2-d86a-4784-b54b-e8d603670ecf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:13.654750 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-396c110e-9972-464d-8159-46401aa405ba tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:13.655288 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-396c110e-9972-464d-8159-46401aa405ba tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:13.667934 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-396c110e-9972-464d-8159-46401aa405ba tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:13.668898 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-396c110e-9972-464d-8159-46401aa405ba tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:13.670614 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-396c110e-9972-464d-8159-46401aa405ba tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:13.671064 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-396c110e-9972-464d-8159-46401aa405ba tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:13.695006 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-396c110e-9972-464d-8159-46401aa405ba tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/ips" status: 200 len: 151 microversion: 2.1 time: 0.044075 May 09 23:07:13.695597 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 272/558] 10.222.0.23 () {58 vars in 1247 bytes} [Mon May 9 23:07:13 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:13.754967 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a3d513d2-d86a-4784-b54b-e8d603670ecf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:13.762951 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a3d513d2-d86a-4784-b54b-e8d603670ecf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:13.764462 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a3d513d2-d86a-4784-b54b-e8d603670ecf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:13.765550 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a3d513d2-d86a-4784-b54b-e8d603670ecf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1405 microversion: 2.20 time: 0.163085 May 09 23:07:13.766792 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 287/559] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:13 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:07:14.440972 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-20eb5140-2456-4a10-990b-32ccf339a8fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:14.441456 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-20eb5140-2456-4a10-990b-32ccf339a8fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:14.450746 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-20eb5140-2456-4a10-990b-32ccf339a8fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:14.451072 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-20eb5140-2456-4a10-990b-32ccf339a8fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:14.451879 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-20eb5140-2456-4a10-990b-32ccf339a8fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:14.452265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-20eb5140-2456-4a10-990b-32ccf339a8fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:14.532048 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-20eb5140-2456-4a10-990b-32ccf339a8fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lazy-loading 'services' on Instance uuid bccbae96-189c-4f1a-8a18-a94e8684d9b6 {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:07:14.602622 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-20eb5140-2456-4a10-990b-32ccf339a8fc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-volume_attachments/a6afe6aa-2659-4976-80d6-142dc63f88b0" status: 202 len: 0 microversion: 2.1 time: 0.165914 May 09 23:07:14.603372 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 273/560] 10.222.0.23 () {58 vars in 1415 bytes} [Mon May 9 23:07:14 2022] DELETE /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-volume_attachments/a6afe6aa-2659-4976-80d6-142dc63f88b0 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 23:07:14.611766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-43b2e23c-4c40-4c7b-b418-8aed959496a6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:14.612694 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-43b2e23c-4c40-4c7b-b418-8aed959496a6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:14.618788 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-43b2e23c-4c40-4c7b-b418-8aed959496a6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:14.619244 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-43b2e23c-4c40-4c7b-b418-8aed959496a6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:14.620009 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-43b2e23c-4c40-4c7b-b418-8aed959496a6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:14.620612 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-43b2e23c-4c40-4c7b-b418-8aed959496a6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:14.651926 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-43b2e23c-4c40-4c7b-b418-8aed959496a6 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 May 09 23:07:14.652514 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 288/561] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:07:14 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:14.785727 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ce339fbb-541b-42bc-9285-f82d77bf82f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:14.786502 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ce339fbb-541b-42bc-9285-f82d77bf82f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:14.792835 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ce339fbb-541b-42bc-9285-f82d77bf82f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:14.793282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ce339fbb-541b-42bc-9285-f82d77bf82f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:14.794172 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ce339fbb-541b-42bc-9285-f82d77bf82f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:14.794789 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ce339fbb-541b-42bc-9285-f82d77bf82f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:14.924150 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ce339fbb-541b-42bc-9285-f82d77bf82f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:14.931813 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ce339fbb-541b-42bc-9285-f82d77bf82f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:14.933306 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ce339fbb-541b-42bc-9285-f82d77bf82f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:14.934432 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ce339fbb-541b-42bc-9285-f82d77bf82f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1405 microversion: 2.20 time: 0.154068 May 09 23:07:14.934990 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 274/562] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:14 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:07:14.999409 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-038052b8-4093-4daf-9960-f1cf6f492053 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc298b6a-1f1d-4c76-8fe4-69e670219826"}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:15.000536 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-038052b8-4093-4daf-9960-f1cf6f492053 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:15.007384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-038052b8-4093-4daf-9960-f1cf6f492053 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:15.007933 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-038052b8-4093-4daf-9960-f1cf6f492053 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:15.008749 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-038052b8-4093-4daf-9960-f1cf6f492053 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:15.009182 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-038052b8-4093-4daf-9960-f1cf6f492053 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:15.232651 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-814a309e-022c-4399-8cac-4c7e01b16abf req-8b8ace7c-f595-46d0-9df2-e2f500d28989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cdc1269-4f55-47ba-8ebc-a403362e1962", "name": "network-vif-plugged", "status": "completed", "tag": "a898f67f-017d-433f-9c0f-e6793182e363"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:15.247317 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-814a309e-022c-4399-8cac-4c7e01b16abf req-8b8ace7c-f595-46d0-9df2-e2f500d28989 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:15.247930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-814a309e-022c-4399-8cac-4c7e01b16abf req-8b8ace7c-f595-46d0-9df2-e2f500d28989 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:15.275412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-814a309e-022c-4399-8cac-4c7e01b16abf req-8b8ace7c-f595-46d0-9df2-e2f500d28989 service nova] Creating event network-vif-plugged:a898f67f-017d-433f-9c0f-e6793182e363 for instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 on hv-cinder-84067 May 09 23:07:15.280721 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-814a309e-022c-4399-8cac-4c7e01b16abf req-8b8ace7c-f595-46d0-9df2-e2f500d28989 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053040 May 09 23:07:15.282306 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 275/563] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:07:15.368308 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-038052b8-4093-4daf-9960-f1cf6f492053 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "POST /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372848 May 09 23:07:15.369324 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 289/564] 10.222.0.23 () {60 vars in 1322 bytes} [Mon May 9 23:07:14 2022] POST /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:07:15.664286 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-3c673cc2-268b-4dc8-a89e-29ad39d68c04 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:15.665329 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-3c673cc2-268b-4dc8-a89e-29ad39d68c04 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:15.671453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3c673cc2-268b-4dc8-a89e-29ad39d68c04 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:15.671905 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3c673cc2-268b-4dc8-a89e-29ad39d68c04 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:15.672733 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3c673cc2-268b-4dc8-a89e-29ad39d68c04 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:15.673175 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3c673cc2-268b-4dc8-a89e-29ad39d68c04 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:15.700894 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-3c673cc2-268b-4dc8-a89e-29ad39d68c04 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040951 May 09 23:07:15.701775 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 276/565] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:07:15 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 23:07:15.773967 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-fdc6bda5-0e9c-4be7-8c4e-c93c60823e58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:15.774604 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-fdc6bda5-0e9c-4be7-8c4e-c93c60823e58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:15.782208 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fdc6bda5-0e9c-4be7-8c4e-c93c60823e58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:15.782670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fdc6bda5-0e9c-4be7-8c4e-c93c60823e58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:15.783451 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fdc6bda5-0e9c-4be7-8c4e-c93c60823e58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:15.783893 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fdc6bda5-0e9c-4be7-8c4e-c93c60823e58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:15.808663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-fdc6bda5-0e9c-4be7-8c4e-c93c60823e58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Going to try to terminate instance {{(pid=117143) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:07:15.886035 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-fdc6bda5-0e9c-4be7-8c4e-c93c60823e58 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 204 len: 0 microversion: 2.1 time: 0.116251 May 09 23:07:15.886980 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 290/566] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:07:15 2022] DELETE /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:07:15.895427 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-01aff9be-ff68-47a0-8b21-197d69c24bfc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:15.896069 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-01aff9be-ff68-47a0-8b21-197d69c24bfc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:15.902255 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-01aff9be-ff68-47a0-8b21-197d69c24bfc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:15.902704 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-01aff9be-ff68-47a0-8b21-197d69c24bfc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:15.903464 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-01aff9be-ff68-47a0-8b21-197d69c24bfc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:15.903893 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-01aff9be-ff68-47a0-8b21-197d69c24bfc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:15.953014 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7308eac9-086a-4439-b621-65aa6b21689c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:15.954343 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7308eac9-086a-4439-b621-65aa6b21689c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:15.960792 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7308eac9-086a-4439-b621-65aa6b21689c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:15.961247 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7308eac9-086a-4439-b621-65aa6b21689c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:15.962027 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7308eac9-086a-4439-b621-65aa6b21689c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:15.962501 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7308eac9-086a-4439-b621-65aa6b21689c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:16.037847 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-01aff9be-ff68-47a0-8b21-197d69c24bfc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:16.045252 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-01aff9be-ff68-47a0-8b21-197d69c24bfc tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1689 microversion: 2.1 time: 0.153784 May 09 23:07:16.045828 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 277/567] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:15 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:16.092232 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7308eac9-086a-4439-b621-65aa6b21689c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:16.099795 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7308eac9-086a-4439-b621-65aa6b21689c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:16.101287 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7308eac9-086a-4439-b621-65aa6b21689c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:16.102399 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7308eac9-086a-4439-b621-65aa6b21689c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1405 microversion: 2.20 time: 0.153737 May 09 23:07:16.102951 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 291/568] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:15 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:07:17.062081 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-3dea7867-d065-4666-9835-16b9f5df7066 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:17.062750 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-3dea7867-d065-4666-9835-16b9f5df7066 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:17.069222 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3dea7867-d065-4666-9835-16b9f5df7066 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:17.069733 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3dea7867-d065-4666-9835-16b9f5df7066 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:17.070540 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3dea7867-d065-4666-9835-16b9f5df7066 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:17.070976 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3dea7867-d065-4666-9835-16b9f5df7066 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:17.120452 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-fdfa3104-dcaa-4776-9b4d-0976901d5eae tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:17.121183 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-fdfa3104-dcaa-4776-9b4d-0976901d5eae tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:17.127601 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fdfa3104-dcaa-4776-9b4d-0976901d5eae tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:17.128054 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fdfa3104-dcaa-4776-9b4d-0976901d5eae tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:17.128829 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fdfa3104-dcaa-4776-9b4d-0976901d5eae tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:17.129270 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fdfa3104-dcaa-4776-9b4d-0976901d5eae tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:17.198479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-3dea7867-d065-4666-9835-16b9f5df7066 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:17.206311 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-3dea7867-d065-4666-9835-16b9f5df7066 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1689 microversion: 2.1 time: 0.148073 May 09 23:07:17.206880 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 278/569] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:17 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:17.254809 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-fdfa3104-dcaa-4776-9b4d-0976901d5eae tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:17.262447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-fdfa3104-dcaa-4776-9b4d-0976901d5eae tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:17.263991 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-fdfa3104-dcaa-4776-9b4d-0976901d5eae tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:17.265125 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-fdfa3104-dcaa-4776-9b4d-0976901d5eae tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1405 microversion: 2.20 time: 0.148694 May 09 23:07:17.266212 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 292/570] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:17 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:07:18.223299 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-08ef45cd-8430-4d37-bef7-c7be497996ae tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:18.223888 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-08ef45cd-8430-4d37-bef7-c7be497996ae tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:18.230102 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-08ef45cd-8430-4d37-bef7-c7be497996ae tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:18.230573 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-08ef45cd-8430-4d37-bef7-c7be497996ae tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:18.231588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-08ef45cd-8430-4d37-bef7-c7be497996ae tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:18.232018 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-08ef45cd-8430-4d37-bef7-c7be497996ae tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:18.283602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-02dc582d-261e-478c-8555-b93ebcd6b364 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:18.284309 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-02dc582d-261e-478c-8555-b93ebcd6b364 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:18.290388 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-02dc582d-261e-478c-8555-b93ebcd6b364 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:18.290840 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-02dc582d-261e-478c-8555-b93ebcd6b364 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:18.291605 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-02dc582d-261e-478c-8555-b93ebcd6b364 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:18.292041 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-02dc582d-261e-478c-8555-b93ebcd6b364 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:18.367953 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-08ef45cd-8430-4d37-bef7-c7be497996ae tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:18.375742 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-08ef45cd-8430-4d37-bef7-c7be497996ae tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1689 microversion: 2.1 time: 0.156770 May 09 23:07:18.376893 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 279/571] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:18 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:18.441223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-02dc582d-261e-478c-8555-b93ebcd6b364 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:18.449533 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-02dc582d-261e-478c-8555-b93ebcd6b364 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:18.451051 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-02dc582d-261e-478c-8555-b93ebcd6b364 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:18.452207 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-02dc582d-261e-478c-8555-b93ebcd6b364 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1405 microversion: 2.20 time: 0.172967 May 09 23:07:18.452778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 293/572] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:18 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:07:19.393546 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9d6b44b6-97cb-49d5-a7be-cd650c27f9b5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:19.394182 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9d6b44b6-97cb-49d5-a7be-cd650c27f9b5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:19.400648 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9d6b44b6-97cb-49d5-a7be-cd650c27f9b5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:19.401098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9d6b44b6-97cb-49d5-a7be-cd650c27f9b5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:19.401888 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9d6b44b6-97cb-49d5-a7be-cd650c27f9b5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:19.402351 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9d6b44b6-97cb-49d5-a7be-cd650c27f9b5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:19.471380 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d2baec77-ce8c-4b1a-9ce0-9531ba911e4f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:19.471972 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d2baec77-ce8c-4b1a-9ce0-9531ba911e4f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:19.478385 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d2baec77-ce8c-4b1a-9ce0-9531ba911e4f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:19.479044 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d2baec77-ce8c-4b1a-9ce0-9531ba911e4f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:19.479582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d2baec77-ce8c-4b1a-9ce0-9531ba911e4f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:19.480078 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d2baec77-ce8c-4b1a-9ce0-9531ba911e4f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:19.529079 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-9d6b44b6-97cb-49d5-a7be-cd650c27f9b5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:19.536957 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9d6b44b6-97cb-49d5-a7be-cd650c27f9b5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1689 microversion: 2.1 time: 0.148175 May 09 23:07:19.537577 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 280/573] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:19 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:19.605934 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d2baec77-ce8c-4b1a-9ce0-9531ba911e4f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:19.614269 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d2baec77-ce8c-4b1a-9ce0-9531ba911e4f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:19.615756 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d2baec77-ce8c-4b1a-9ce0-9531ba911e4f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:19.616860 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d2baec77-ce8c-4b1a-9ce0-9531ba911e4f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1405 microversion: 2.20 time: 0.150058 May 09 23:07:19.617651 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 294/574] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:19 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:07:19.639173 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5a462740-fe22-4f47-a80d-949102bef687 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1330116907"}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:19.639763 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5a462740-fe22-4f47-a80d-949102bef687 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:19.646659 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5a462740-fe22-4f47-a80d-949102bef687 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:19.647114 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5a462740-fe22-4f47-a80d-949102bef687 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:19.647923 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5a462740-fe22-4f47-a80d-949102bef687 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:19.648365 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5a462740-fe22-4f47-a80d-949102bef687 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:19.785192 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.network.security_group_api [None req-5a462740-fe22-4f47-a80d-949102bef687 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Removing security group c3c34fa7-022c-4947-82d8-84d73b758654 from port 49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787 May 09 23:07:20.149158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5a462740-fe22-4f47-a80d-949102bef687 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "POST /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/action" status: 202 len: 0 microversion: 2.1 time: 0.514035 May 09 23:07:20.149948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 281/575] 10.222.0.23 () {60 vars in 1277 bytes} [Mon May 9 23:07:19 2022] POST /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:07:20.159159 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-ab842592-b0a6-4e75-9504-b6ec6115cde3 req-caed2374-e50b-4058-a4cf-da2c79ce2cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93373b9f-f998-4983-9b08-7b874cf7c76e", "tag": "49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:20.172333 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-ab842592-b0a6-4e75-9504-b6ec6115cde3 req-caed2374-e50b-4058-a4cf-da2c79ce2cf2 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:20.173478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-ab842592-b0a6-4e75-9504-b6ec6115cde3 req-caed2374-e50b-4058-a4cf-da2c79ce2cf2 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:20.192051 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-ab842592-b0a6-4e75-9504-b6ec6115cde3 req-caed2374-e50b-4058-a4cf-da2c79ce2cf2 service nova] Creating event network-changed:49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787 for instance 93373b9f-f998-4983-9b08-7b874cf7c76e on hv-cinder-84067 May 09 23:07:20.203110 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-ab842592-b0a6-4e75-9504-b6ec6115cde3 req-caed2374-e50b-4058-a4cf-da2c79ce2cf2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048543 May 09 23:07:20.207437 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 295/576] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:07:20.554502 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-7a88afba-77ff-4b82-b262-38a5a2575b38 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:20.555737 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-7a88afba-77ff-4b82-b262-38a5a2575b38 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:20.562623 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7a88afba-77ff-4b82-b262-38a5a2575b38 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:20.563280 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7a88afba-77ff-4b82-b262-38a5a2575b38 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:20.564233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7a88afba-77ff-4b82-b262-38a5a2575b38 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:20.564907 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7a88afba-77ff-4b82-b262-38a5a2575b38 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:20.638070 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7e1d92f6-37bc-40cb-917d-425d9e973ad4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:20.638070 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7e1d92f6-37bc-40cb-917d-425d9e973ad4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:20.645241 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7e1d92f6-37bc-40cb-917d-425d9e973ad4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:20.645700 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7e1d92f6-37bc-40cb-917d-425d9e973ad4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:20.646595 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7e1d92f6-37bc-40cb-917d-425d9e973ad4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:20.647034 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7e1d92f6-37bc-40cb-917d-425d9e973ad4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:21.128987 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-7a88afba-77ff-4b82-b262-38a5a2575b38 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:21.137249 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-7a88afba-77ff-4b82-b262-38a5a2575b38 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1689 microversion: 2.1 time: 0.587005 May 09 23:07:21.137999 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 282/577] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:20 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1689 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:21.156385 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7e1d92f6-37bc-40cb-917d-425d9e973ad4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:21.165467 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7e1d92f6-37bc-40cb-917d-425d9e973ad4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:21.167306 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7e1d92f6-37bc-40cb-917d-425d9e973ad4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:21.168684 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7e1d92f6-37bc-40cb-917d-425d9e973ad4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1598 microversion: 2.20 time: 0.537257 May 09 23:07:21.169598 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 296/578] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:07:20 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1598 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:07:21.186143 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-80116632-ddf0-4eef-b776-7bd889913ccf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:21.186809 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-80116632-ddf0-4eef-b776-7bd889913ccf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:21.193659 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-80116632-ddf0-4eef-b776-7bd889913ccf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:21.194637 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-80116632-ddf0-4eef-b776-7bd889913ccf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:21.195521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-80116632-ddf0-4eef-b776-7bd889913ccf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:21.196057 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-80116632-ddf0-4eef-b776-7bd889913ccf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:21.313842 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-80116632-ddf0-4eef-b776-7bd889913ccf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.130740 May 09 23:07:21.321911 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 283/579] 10.222.0.23 () {60 vars in 1315 bytes} [Mon May 9 23:07:21 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 23:07:22.172349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2ad28a71-3ea3-46de-ba9a-f6e16eabedd3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:22.173661 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2ad28a71-3ea3-46de-ba9a-f6e16eabedd3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:22.180568 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-09409528-413f-4add-8f7d-0b53b182e3a5 req-be6165e0-ad30-42e2-9a99-e8b4a046d10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bccbae96-189c-4f1a-8a18-a94e8684d9b6", "name": "network-vif-deleted", "tag": "f4111c9d-b7d8-4877-85f0-8a4596bfc164"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:22.197148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-09409528-413f-4add-8f7d-0b53b182e3a5 req-be6165e0-ad30-42e2-9a99-e8b4a046d10b service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:22.197766 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-09409528-413f-4add-8f7d-0b53b182e3a5 req-be6165e0-ad30-42e2-9a99-e8b4a046d10b service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:22.198773 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2ad28a71-3ea3-46de-ba9a-f6e16eabedd3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:22.199489 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2ad28a71-3ea3-46de-ba9a-f6e16eabedd3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:22.200493 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2ad28a71-3ea3-46de-ba9a-f6e16eabedd3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:22.201155 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2ad28a71-3ea3-46de-ba9a-f6e16eabedd3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:22.216587 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-09409528-413f-4add-8f7d-0b53b182e3a5 req-be6165e0-ad30-42e2-9a99-e8b4a046d10b service nova] Creating event network-vif-deleted:f4111c9d-b7d8-4877-85f0-8a4596bfc164 for instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 on hv-cinder-84067 May 09 23:07:22.226406 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-09409528-413f-4add-8f7d-0b53b182e3a5 req-be6165e0-ad30-42e2-9a99-e8b4a046d10b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049397 May 09 23:07:22.227499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 284/580] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:22.298855 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2ad28a71-3ea3-46de-ba9a-f6e16eabedd3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:22.311853 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2ad28a71-3ea3-46de-ba9a-f6e16eabedd3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 200 len: 1621 microversion: 2.1 time: 0.157715 May 09 23:07:22.323354 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 297/581] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:22 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 1621 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:22.422486 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1591bbcd-75b9-45ec-8645-86c2a223f079 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:22.423075 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1591bbcd-75b9-45ec-8645-86c2a223f079 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:22.437136 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1591bbcd-75b9-45ec-8645-86c2a223f079 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:22.437981 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1591bbcd-75b9-45ec-8645-86c2a223f079 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:22.443799 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1591bbcd-75b9-45ec-8645-86c2a223f079 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:22.446268 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1591bbcd-75b9-45ec-8645-86c2a223f079 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:22.569224 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-1591bbcd-75b9-45ec-8645-86c2a223f079 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lazy-loading 'services' on Instance uuid 93373b9f-f998-4983-9b08-7b874cf7c76e {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:07:22.673187 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1591bbcd-75b9-45ec-8645-86c2a223f079 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "DELETE /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments/c26e30b3-f769-4898-a256-1675f2d077b0" status: 202 len: 0 microversion: 2.1 time: 0.255914 May 09 23:07:22.674650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 285/582] 10.222.0.23 () {58 vars in 1415 bytes} [Mon May 9 23:07:22 2022] DELETE /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments/c26e30b3-f769-4898-a256-1675f2d077b0 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:07:22.682751 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e35d8946-caa4-4dae-801c-71c58d1344e9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:22.683950 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e35d8946-caa4-4dae-801c-71c58d1344e9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:22.690743 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e35d8946-caa4-4dae-801c-71c58d1344e9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:22.691336 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e35d8946-caa4-4dae-801c-71c58d1344e9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:22.692215 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e35d8946-caa4-4dae-801c-71c58d1344e9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:22.692905 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e35d8946-caa4-4dae-801c-71c58d1344e9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:22.724956 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e35d8946-caa4-4dae-801c-71c58d1344e9 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045885 May 09 23:07:22.725989 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 298/583] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:07:22 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:22.797503 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-f44379b5-fb6c-4f0f-b703-0d099d025988 req-f5a3038a-1fff-41af-a889-affffdf3a958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cdc1269-4f55-47ba-8ebc-a403362e1962", "tag": "a898f67f-017d-433f-9c0f-e6793182e363"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:22.809212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-f44379b5-fb6c-4f0f-b703-0d099d025988 req-f5a3038a-1fff-41af-a889-affffdf3a958 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:22.809724 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-f44379b5-fb6c-4f0f-b703-0d099d025988 req-f5a3038a-1fff-41af-a889-affffdf3a958 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:22.850016 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-f44379b5-fb6c-4f0f-b703-0d099d025988 req-f5a3038a-1fff-41af-a889-affffdf3a958 service nova] Creating event network-changed:a898f67f-017d-433f-9c0f-e6793182e363 for instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 on hv-cinder-84067 May 09 23:07:22.857506 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-f44379b5-fb6c-4f0f-b703-0d099d025988 req-f5a3038a-1fff-41af-a889-affffdf3a958 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064084 May 09 23:07:22.858829 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 286/584] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:23.329190 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a0f564aa-900b-4185-adf3-4610c46baf91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:23.330612 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a0f564aa-900b-4185-adf3-4610c46baf91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: bccbae96-189c-4f1a-8a18-a94e8684d9b6] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:23.341702 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a0f564aa-900b-4185-adf3-4610c46baf91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:23.342547 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a0f564aa-900b-4185-adf3-4610c46baf91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:23.343503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a0f564aa-900b-4185-adf3-4610c46baf91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:23.345453 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a0f564aa-900b-4185-adf3-4610c46baf91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:23.365288 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-a0f564aa-900b-4185-adf3-4610c46baf91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] HTTP exception thrown: Instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 could not be found. May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a0f564aa-900b-4185-adf3-4610c46baf91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Request method failure captured: May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 HTTP/1.1 May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ2FFz9vnmF8wAewdVUSwImcpsQ_FwsT9_7-H0Toz28qyLF5raYcR0RdwhQ7DcuMUUb6fbU3N9fxJ3lqVbGJA-eSv-tQlbFOPaZxX5sJAbjs8F6A88WSsbHqIz7xSQ8sIzcyDrkQNCaIK1p8i0U8DUR4GQ-9BgcmVdUyMXRTEAlwBLw May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 0cb055ff9f0d4af6962070c7a2f19bf3 May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:07:23.366990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:07:23.368602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:07:23.368602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:07:23.368602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 0cb055ff9f0d4af6962070c7a2f19bf3 May 09 23:07:23.368602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:07:23.368602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-ServerRescueNegativeTestJSON-345311633-project May 09 23:07:23.368602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:07:23.368602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:07:23.368602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: e41b4feaa9be44e89210b70c19ef10ab May 09 23:07:23.368602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-ServerRescueNegativeTestJSON-345311633-project May 09 23:07:23.368602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:07:23.368602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 could not be found. May 09 23:07:23.368602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': 'bccbae96-189c-4f1a-8a18-a94e8684d9b6'} May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 could not be found. May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:07:23.369512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 could not be found. May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 could not be found. May 09 23:07:23.372622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:23.374110 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a0f564aa-900b-4185-adf3-4610c46baf91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Returning 404 to user: Instance bccbae96-189c-4f1a-8a18-a94e8684d9b6 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:07:23.374110 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a0f564aa-900b-4185-adf3-4610c46baf91 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6" status: 404 len: 111 microversion: 2.1 time: 0.043252 May 09 23:07:23.378473 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a4ce7192-8f37-4b14-9314-c2dfa7947fa7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '.version_select at 0x7fc28baa8820>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:23.381916 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 299/585] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:23 2022] GET /compute/v2.1/servers/bccbae96-189c-4f1a-8a18-a94e8684d9b6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:07:23.412216 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a4ce7192-8f37-4b14-9314-c2dfa7947fa7 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068948099" status: 202 len: 0 microversion: 2.1 time: 0.038450 May 09 23:07:23.426720 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 287/586] 10.222.0.23 () {58 vars in 1220 bytes} [Mon May 9 23:07:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068948099 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:07:23.740142 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-586ce996-a0b6-4ea0-82e6-43e788528380 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:23.741312 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-586ce996-a0b6-4ea0-82e6-43e788528380 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:23.755829 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-586ce996-a0b6-4ea0-82e6-43e788528380 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:23.757346 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-586ce996-a0b6-4ea0-82e6-43e788528380 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:23.759223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-586ce996-a0b6-4ea0-82e6-43e788528380 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:23.760696 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-586ce996-a0b6-4ea0-82e6-43e788528380 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:23.819127 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-586ce996-a0b6-4ea0-82e6-43e788528380 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085553 May 09 23:07:23.825099 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 300/587] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:07:23 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:24.271131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-0a91b656-0973-41e1-8894-c0742536988b req-f831afa2-ffd8-4960-96f3-f7700f35af06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93373b9f-f998-4983-9b08-7b874cf7c76e", "tag": "49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:24.280227 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-0a91b656-0973-41e1-8894-c0742536988b req-f831afa2-ffd8-4960-96f3-f7700f35af06 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:24.280707 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-0a91b656-0973-41e1-8894-c0742536988b req-f831afa2-ffd8-4960-96f3-f7700f35af06 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:24.292050 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-0a91b656-0973-41e1-8894-c0742536988b req-f831afa2-ffd8-4960-96f3-f7700f35af06 service nova] Creating event network-changed:49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787 for instance 93373b9f-f998-4983-9b08-7b874cf7c76e on hv-cinder-84067 May 09 23:07:24.297037 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-0a91b656-0973-41e1-8894-c0742536988b req-f831afa2-ffd8-4960-96f3-f7700f35af06 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029427 May 09 23:07:24.297650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 288/588] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:07:24.831479 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-741b10f2-beea-4f24-a08b-bbbfac63220c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:24.832296 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-741b10f2-beea-4f24-a08b-bbbfac63220c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:24.838514 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-741b10f2-beea-4f24-a08b-bbbfac63220c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:24.838956 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-741b10f2-beea-4f24-a08b-bbbfac63220c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:24.839707 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-741b10f2-beea-4f24-a08b-bbbfac63220c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:24.840142 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-741b10f2-beea-4f24-a08b-bbbfac63220c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:24.867613 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-741b10f2-beea-4f24-a08b-bbbfac63220c tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040770 May 09 23:07:24.868176 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 301/589] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:07:24 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:25.880093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-6329172e-d797-4c5f-a462-7f32454c109f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:25.881081 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-6329172e-d797-4c5f-a462-7f32454c109f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:25.887597 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6329172e-d797-4c5f-a462-7f32454c109f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:25.888041 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6329172e-d797-4c5f-a462-7f32454c109f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:25.888812 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6329172e-d797-4c5f-a462-7f32454c109f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:25.889286 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6329172e-d797-4c5f-a462-7f32454c109f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:25.921238 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-6329172e-d797-4c5f-a462-7f32454c109f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045924 May 09 23:07:25.921815 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 289/590] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:07:25 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:26.118443 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d3ce5098-acd8-4c36-8f4d-a57f9771ac0b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc298b6a-1f1d-4c76-8fe4-69e670219826"}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:26.119515 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d3ce5098-acd8-4c36-8f4d-a57f9771ac0b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:26.125700 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d3ce5098-acd8-4c36-8f4d-a57f9771ac0b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:26.126182 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d3ce5098-acd8-4c36-8f4d-a57f9771ac0b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:26.126954 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d3ce5098-acd8-4c36-8f4d-a57f9771ac0b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:26.127388 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d3ce5098-acd8-4c36-8f4d-a57f9771ac0b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:26.203402 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-d3ce5098-acd8-4c36-8f4d-a57f9771ac0b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] HTTP exception thrown: Invalid volume: volume cc298b6a-1f1d-4c76-8fe4-69e670219826 is already attached to instances: 31ea1b8e-49ff-4716-8cbf-ca11225258aa May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d3ce5098-acd8-4c36-8f4d-a57f9771ac0b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Request method failure captured: May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: POST /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments HTTP/1.1 May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 74 May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ2AZq5EfNRX4A2tCiVwicbnfgrKkrL1gKGZ2i9kDkpeQEVnPD6CHxNPMLHcnk-nNrqb42O05Dml9fFcVJ8tZC-e8-FzgQMzIs0cjdHVhCDJH8lgSgXK8gUI8fFy_4mLaumbFrU7L_T2O0x7fdFRFsthOIPJ0V_6K6OxmafCQoxWJqE May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:07:26.205225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:07:26.206837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b776734a879d4c0785b1d3728b79b766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:07:26.206837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:07:26.206837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:07:26.206837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:07:26.206837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:07:26.206837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:07:26.206837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:07:26.206837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 84a45506c19c4cda8173c164a097f925 May 09 23:07:26.206837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:07:26.206837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: May 09 23:07:26.206837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {"volumeAttachment": {"volumeId": "cc298b6a-1f1d-4c76-8fe4-69e670219826"}} May 09 23:07:26.206837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Invalid volume: volume cc298b6a-1f1d-4c76-8fe4-69e670219826 is already attached to instances: 31ea1b8e-49ff-4716-8cbf-ca11225258aa May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'server_id': '31ea1b8e-49ff-4716-8cbf-ca11225258aa', 'body': {'volumeAttachment': {'volumeId': 'cc298b6a-1f1d-4c76-8fe4-69e670219826'}}} May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cc298b6a-1f1d-4c76-8fe4-69e670219826 is already attached to instances: 31ea1b8e-49ff-4716-8cbf-ca11225258aa May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:26.207679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cc298b6a-1f1d-4c76-8fe4-69e670219826 is already attached to instances: 31ea1b8e-49ff-4716-8cbf-ca11225258aa May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:26.209024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:26.210452 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:26.210452 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:07:26.210452 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:07:26.210452 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cc298b6a-1f1d-4c76-8fe4-69e670219826 is already attached to instances: 31ea1b8e-49ff-4716-8cbf-ca11225258aa May 09 23:07:26.210452 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:26.210452 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d3ce5098-acd8-4c36-8f4d-a57f9771ac0b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Returning 400 to user: Invalid volume: volume cc298b6a-1f1d-4c76-8fe4-69e670219826 is already attached to instances: 31ea1b8e-49ff-4716-8cbf-ca11225258aa {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:07:26.210452 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d3ce5098-acd8-4c36-8f4d-a57f9771ac0b tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "POST /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092314 May 09 23:07:26.210452 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 302/591] 10.222.0.23 () {60 vars in 1322 bytes} [Mon May 9 23:07:26 2022] POST /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 23:07:26.267520 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5ce54ba6-3af8-4686-92c4-61fbaef65817 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:26.268013 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5ce54ba6-3af8-4686-92c4-61fbaef65817 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:26.273859 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5ce54ba6-3af8-4686-92c4-61fbaef65817 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:26.274348 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5ce54ba6-3af8-4686-92c4-61fbaef65817 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:26.275170 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5ce54ba6-3af8-4686-92c4-61fbaef65817 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:26.275606 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5ce54ba6-3af8-4686-92c4-61fbaef65817 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:26.352909 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-5ce54ba6-3af8-4686-92c4-61fbaef65817 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lazy-loading 'services' on Instance uuid 31ea1b8e-49ff-4716-8cbf-ca11225258aa {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:07:26.392647 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-3202cfae-8417-4826-ae2d-0d926375eb77 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:26.393299 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-3202cfae-8417-4826-ae2d-0d926375eb77 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:26.399567 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3202cfae-8417-4826-ae2d-0d926375eb77 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:26.400103 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3202cfae-8417-4826-ae2d-0d926375eb77 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:26.400977 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3202cfae-8417-4826-ae2d-0d926375eb77 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:26.401491 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3202cfae-8417-4826-ae2d-0d926375eb77 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:26.432782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-3202cfae-8417-4826-ae2d-0d926375eb77 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Going to try to terminate instance {{(pid=117143) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:07:26.439910 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5ce54ba6-3af8-4686-92c4-61fbaef65817 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments/cc298b6a-1f1d-4c76-8fe4-69e670219826" status: 202 len: 0 microversion: 2.1 time: 0.176757 May 09 23:07:26.440774 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 290/592] 10.222.0.23 () {58 vars in 1415 bytes} [Mon May 9 23:07:26 2022] DELETE /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments/cc298b6a-1f1d-4c76-8fe4-69e670219826 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:07:26.452506 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e6002646-b106-44c0-a9dc-69389cc3aa9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:26.453928 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e6002646-b106-44c0-a9dc-69389cc3aa9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:26.462962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e6002646-b106-44c0-a9dc-69389cc3aa9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:26.463893 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e6002646-b106-44c0-a9dc-69389cc3aa9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:26.464890 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e6002646-b106-44c0-a9dc-69389cc3aa9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:26.465329 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e6002646-b106-44c0-a9dc-69389cc3aa9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:26.501241 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e6002646-b106-44c0-a9dc-69389cc3aa9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055495 May 09 23:07:26.502024 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 291/593] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:07:26 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:07:26.535451 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-3202cfae-8417-4826-ae2d-0d926375eb77 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 204 len: 0 microversion: 2.1 time: 0.147250 May 09 23:07:26.537274 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 303/594] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:07:26 2022] DELETE /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:07:26.545452 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5c948012-b1cf-46c5-bc22-981ab3891166 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:26.546061 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5c948012-b1cf-46c5-bc22-981ab3891166 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:26.552373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5c948012-b1cf-46c5-bc22-981ab3891166 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:26.552895 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5c948012-b1cf-46c5-bc22-981ab3891166 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:26.553737 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5c948012-b1cf-46c5-bc22-981ab3891166 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:26.554225 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5c948012-b1cf-46c5-bc22-981ab3891166 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:26.684535 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5c948012-b1cf-46c5-bc22-981ab3891166 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:26.692339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5c948012-b1cf-46c5-bc22-981ab3891166 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1509 microversion: 2.1 time: 0.150790 May 09 23:07:26.692916 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 292/595] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:26 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:26.933433 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5125f6fe-9fef-4e83-a99e-cb40eca64fd1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:26.934373 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-5125f6fe-9fef-4e83-a99e-cb40eca64fd1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:26.940244 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5125f6fe-9fef-4e83-a99e-cb40eca64fd1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:26.940684 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5125f6fe-9fef-4e83-a99e-cb40eca64fd1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:26.941441 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5125f6fe-9fef-4e83-a99e-cb40eca64fd1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:26.941866 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5125f6fe-9fef-4e83-a99e-cb40eca64fd1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:26.969817 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-5125f6fe-9fef-4e83-a99e-cb40eca64fd1 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040745 May 09 23:07:26.970382 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 304/596] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:07:26 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 23:07:26.980033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-247022c3-086c-425c-b395-a4f4def9af47 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:26.980513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-247022c3-086c-425c-b395-a4f4def9af47 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:26.987102 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-247022c3-086c-425c-b395-a4f4def9af47 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:26.987557 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-247022c3-086c-425c-b395-a4f4def9af47 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:26.988323 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-247022c3-086c-425c-b395-a4f4def9af47 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:26.988758 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-247022c3-086c-425c-b395-a4f4def9af47 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:27.060139 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-247022c3-086c-425c-b395-a4f4def9af47 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] HTTP exception thrown: Instance 93373b9f-f998-4983-9b08-7b874cf7c76e is not attached to volume c26e30b3-f769-4898-a256-1675f2d077b0 May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-247022c3-086c-425c-b395-a4f4def9af47 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Request method failure captured: May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: DELETE /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments/c26e30b3-f769-4898-a256-1675f2d077b0 HTTP/1.1 May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ3whPR8Pl-5BsaA6uHzmnkCA7fqz8y9XVnoW30w5BU2P8GWLvyUK1J6vpCAqNDI6FmBWXhWkEGA0-holkyb9n7pc44kweTLRspnauFhkfvAsAWsRSkimO8hmgzRb8wurXwsebkZwkIWmHdLPgcVn5HCdRIy_PfYDg9-W9ZN8MtsfWI May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: 93df4f41ba52453dabfd21f82cb9238b May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-TestMinimumBasicScenario-1147938025 May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:07:27.067566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:07:27.069030 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/93df4f41ba52453dabfd21f82cb9238b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_93df4f41ba52453dabfd21f82cb9238b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/93df4f41ba52453dabfd21f82cb9238b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/93df4f41ba52453dabfd21f82cb9238b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:07:27.069030 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-TestMinimumBasicScenario-1147938025 May 09 23:07:27.069030 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: 93df4f41ba52453dabfd21f82cb9238b May 09 23:07:27.069030 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1147938025 May 09 23:07:27.069030 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-TestMinimumBasicScenario-1147938025-project May 09 23:07:27.069030 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:07:27.069030 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:07:27.069030 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 19fbe84526dd48a6be14c1aebf5713c0 May 09 23:07:27.069030 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-TestMinimumBasicScenario-1147938025-project May 09 23:07:27.069030 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:07:27.069030 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 93373b9f-f998-4983-9b08-7b874cf7c76e is not attached to volume c26e30b3-f769-4898-a256-1675f2d077b0 May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'server_id': '93373b9f-f998-4983-9b08-7b874cf7c76e', 'id': 'c26e30b3-f769-4898-a256-1675f2d077b0'} May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c26e30b3-f769-4898-a256-1675f2d077b0. May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:07:27.069705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93373b9f-f998-4983-9b08-7b874cf7c76e is not attached to volume c26e30b3-f769-4898-a256-1675f2d077b0 May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93373b9f-f998-4983-9b08-7b874cf7c76e is not attached to volume c26e30b3-f769-4898-a256-1675f2d077b0 May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:27.070931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-247022c3-086c-425c-b395-a4f4def9af47 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Returning 404 to user: Instance 93373b9f-f998-4983-9b08-7b874cf7c76e is not attached to volume c26e30b3-f769-4898-a256-1675f2d077b0 {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:07:27.071797 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-247022c3-086c-425c-b395-a4f4def9af47 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "DELETE /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments/c26e30b3-f769-4898-a256-1675f2d077b0" status: 404 len: 154 microversion: 2.1 time: 0.092987 May 09 23:07:27.071797 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 293/597] 10.222.0.23 () {58 vars in 1415 bytes} [Mon May 9 23:07:26 2022] DELETE /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e/os-volume_attachments/c26e30b3-f769-4898-a256-1675f2d077b0 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:07:27.513269 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f56e2556-c0c8-48ba-b501-27477017bb3f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:27.514216 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f56e2556-c0c8-48ba-b501-27477017bb3f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:27.520965 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f56e2556-c0c8-48ba-b501-27477017bb3f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:27.521413 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f56e2556-c0c8-48ba-b501-27477017bb3f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:27.522200 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f56e2556-c0c8-48ba-b501-27477017bb3f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:27.522634 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f56e2556-c0c8-48ba-b501-27477017bb3f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:27.550728 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f56e2556-c0c8-48ba-b501-27477017bb3f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041493 May 09 23:07:27.551275 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 305/598] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:07:27 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:27.709375 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-991ee454-5d31-44a9-81fe-0e9ad09f4319 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:27.710029 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-991ee454-5d31-44a9-81fe-0e9ad09f4319 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:27.715887 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-991ee454-5d31-44a9-81fe-0e9ad09f4319 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:27.716335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-991ee454-5d31-44a9-81fe-0e9ad09f4319 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:27.717096 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-991ee454-5d31-44a9-81fe-0e9ad09f4319 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:27.717526 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-991ee454-5d31-44a9-81fe-0e9ad09f4319 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:27.843180 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-991ee454-5d31-44a9-81fe-0e9ad09f4319 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:27.850409 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-991ee454-5d31-44a9-81fe-0e9ad09f4319 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1509 microversion: 2.1 time: 0.144992 May 09 23:07:27.850972 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 294/599] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:27 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1509 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:28.197519 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-85ba0ff6-199f-4a0b-9b64-1a3c8aecf524 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:28.198011 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-85ba0ff6-199f-4a0b-9b64-1a3c8aecf524 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:28.204280 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-85ba0ff6-199f-4a0b-9b64-1a3c8aecf524 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:28.204722 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-85ba0ff6-199f-4a0b-9b64-1a3c8aecf524 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:28.205469 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-85ba0ff6-199f-4a0b-9b64-1a3c8aecf524 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:28.205892 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-85ba0ff6-199f-4a0b-9b64-1a3c8aecf524 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:28.229360 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-85ba0ff6-199f-4a0b-9b64-1a3c8aecf524 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Going to try to terminate instance {{(pid=117143) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:07:28.298981 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-85ba0ff6-199f-4a0b-9b64-1a3c8aecf524 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "DELETE /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 204 len: 0 microversion: 2.1 time: 0.104972 May 09 23:07:28.299556 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 306/600] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:07:28 2022] DELETE /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:07:28.307867 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f0dd0375-4630-4a64-8f7c-150590bcd60d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:28.308485 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f0dd0375-4630-4a64-8f7c-150590bcd60d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:28.315069 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f0dd0375-4630-4a64-8f7c-150590bcd60d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:28.315519 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f0dd0375-4630-4a64-8f7c-150590bcd60d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:28.316285 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f0dd0375-4630-4a64-8f7c-150590bcd60d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:28.316725 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f0dd0375-4630-4a64-8f7c-150590bcd60d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:28.441127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f0dd0375-4630-4a64-8f7c-150590bcd60d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:28.448560 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f0dd0375-4630-4a64-8f7c-150590bcd60d tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1553 microversion: 2.1 time: 0.144395 May 09 23:07:28.449132 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 295/601] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:28 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:07:28.563133 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6307832d-1547-4c31-857b-b79fd3ae55cb tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:28.564137 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6307832d-1547-4c31-857b-b79fd3ae55cb tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:28.570341 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6307832d-1547-4c31-857b-b79fd3ae55cb tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:28.570784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6307832d-1547-4c31-857b-b79fd3ae55cb tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:28.571646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6307832d-1547-4c31-857b-b79fd3ae55cb tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:28.572072 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6307832d-1547-4c31-857b-b79fd3ae55cb tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:28.600298 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6307832d-1547-4c31-857b-b79fd3ae55cb tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041952 May 09 23:07:28.600854 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 307/602] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:07:28 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:28.867600 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e9c0a91f-036e-4820-b02c-9d1ce76057d3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:28.868216 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e9c0a91f-036e-4820-b02c-9d1ce76057d3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:28.874160 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e9c0a91f-036e-4820-b02c-9d1ce76057d3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:28.874622 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e9c0a91f-036e-4820-b02c-9d1ce76057d3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:28.875395 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e9c0a91f-036e-4820-b02c-9d1ce76057d3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:28.875837 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e9c0a91f-036e-4820-b02c-9d1ce76057d3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:29.004742 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e9c0a91f-036e-4820-b02c-9d1ce76057d3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:29.011969 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e9c0a91f-036e-4820-b02c-9d1ce76057d3 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1509 microversion: 2.1 time: 0.148249 May 09 23:07:29.012554 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 296/603] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:28 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:29.466502 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-faf58bf3-e94b-4c1a-a8cc-8fb6b9a22e9f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:29.467143 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-faf58bf3-e94b-4c1a-a8cc-8fb6b9a22e9f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:29.473550 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-faf58bf3-e94b-4c1a-a8cc-8fb6b9a22e9f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:29.473982 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-faf58bf3-e94b-4c1a-a8cc-8fb6b9a22e9f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:29.474777 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-faf58bf3-e94b-4c1a-a8cc-8fb6b9a22e9f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:29.475212 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-faf58bf3-e94b-4c1a-a8cc-8fb6b9a22e9f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:29.612399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-25b7bf2a-ada0-4cfe-8938-5941084a12a2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:29.613399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-25b7bf2a-ada0-4cfe-8938-5941084a12a2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:29.619844 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-25b7bf2a-ada0-4cfe-8938-5941084a12a2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:29.620298 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-25b7bf2a-ada0-4cfe-8938-5941084a12a2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:29.621072 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-25b7bf2a-ada0-4cfe-8938-5941084a12a2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:29.621511 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-25b7bf2a-ada0-4cfe-8938-5941084a12a2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:29.653205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-25b7bf2a-ada0-4cfe-8938-5941084a12a2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045187 May 09 23:07:29.653786 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 297/604] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:07:29 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:07:29.654449 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-faf58bf3-e94b-4c1a-a8cc-8fb6b9a22e9f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:29.662453 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-faf58bf3-e94b-4c1a-a8cc-8fb6b9a22e9f tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1553 microversion: 2.1 time: 0.199779 May 09 23:07:29.663009 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 308/605] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:29 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:30.029011 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0cae2952-eb31-4b3f-8883-d694b30282af tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:30.029662 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-0cae2952-eb31-4b3f-8883-d694b30282af tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:30.036094 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0cae2952-eb31-4b3f-8883-d694b30282af tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:30.036549 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0cae2952-eb31-4b3f-8883-d694b30282af tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:30.037324 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0cae2952-eb31-4b3f-8883-d694b30282af tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:30.037760 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0cae2952-eb31-4b3f-8883-d694b30282af tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:30.169166 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-0cae2952-eb31-4b3f-8883-d694b30282af tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:30.177311 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0cae2952-eb31-4b3f-8883-d694b30282af tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1509 microversion: 2.1 time: 0.152121 May 09 23:07:30.177888 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 298/606] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:30 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:30.665108 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-52942009-66c8-4fa9-b5ff-06498240b2be tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:30.666024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-52942009-66c8-4fa9-b5ff-06498240b2be tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:30.674143 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-52942009-66c8-4fa9-b5ff-06498240b2be tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:30.674584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-52942009-66c8-4fa9-b5ff-06498240b2be tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:30.675368 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-52942009-66c8-4fa9-b5ff-06498240b2be tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:30.676031 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-52942009-66c8-4fa9-b5ff-06498240b2be tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:30.679618 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-944ae5ac-6799-472f-82ae-f70927c87cff tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:30.680296 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-944ae5ac-6799-472f-82ae-f70927c87cff tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:30.687315 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-944ae5ac-6799-472f-82ae-f70927c87cff tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:30.687315 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-944ae5ac-6799-472f-82ae-f70927c87cff tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:30.688068 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-944ae5ac-6799-472f-82ae-f70927c87cff tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:30.688532 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-944ae5ac-6799-472f-82ae-f70927c87cff tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:30.705679 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-52942009-66c8-4fa9-b5ff-06498240b2be tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044636 May 09 23:07:30.706198 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 309/607] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:07:30 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:30.824951 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-944ae5ac-6799-472f-82ae-f70927c87cff tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:30.834940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-944ae5ac-6799-472f-82ae-f70927c87cff tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1553 microversion: 2.1 time: 0.159022 May 09 23:07:30.835529 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 299/608] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:30 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:07:31.194357 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-84de0e54-91b3-4859-a2b9-88b7b28427a1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:31.195463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-84de0e54-91b3-4859-a2b9-88b7b28427a1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:31.201789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84de0e54-91b3-4859-a2b9-88b7b28427a1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:31.202510 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84de0e54-91b3-4859-a2b9-88b7b28427a1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:31.203830 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84de0e54-91b3-4859-a2b9-88b7b28427a1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:31.204262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84de0e54-91b3-4859-a2b9-88b7b28427a1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:31.360732 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-c812cad8-9bd2-48c2-b527-8a74ed63cc2c req-33ee9d3b-b77e-4cc3-8cad-48cb8fafb19e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93373b9f-f998-4983-9b08-7b874cf7c76e", "name": "network-vif-deleted", "tag": "49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:31.368818 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-c812cad8-9bd2-48c2-b527-8a74ed63cc2c req-33ee9d3b-b77e-4cc3-8cad-48cb8fafb19e service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:31.369264 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-c812cad8-9bd2-48c2-b527-8a74ed63cc2c req-33ee9d3b-b77e-4cc3-8cad-48cb8fafb19e service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:31.383141 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-c812cad8-9bd2-48c2-b527-8a74ed63cc2c req-33ee9d3b-b77e-4cc3-8cad-48cb8fafb19e service nova] Creating event network-vif-deleted:49d2bc9f-2654-4a59-8bb4-3ecfbc3f8787 for instance 93373b9f-f998-4983-9b08-7b874cf7c76e on hv-cinder-84067 May 09 23:07:31.387945 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-c812cad8-9bd2-48c2-b527-8a74ed63cc2c req-33ee9d3b-b77e-4cc3-8cad-48cb8fafb19e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031820 May 09 23:07:31.388554 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 300/609] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:31.397214 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-84de0e54-91b3-4859-a2b9-88b7b28427a1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:31.416511 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-84de0e54-91b3-4859-a2b9-88b7b28427a1 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1509 microversion: 2.1 time: 0.225998 May 09 23:07:31.417187 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 310/610] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:31 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:31.508635 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-a5902db8-b471-4308-8072-cc3098ca7274 req-4cd8969c-5dd3-445a-b5ea-11a31761ffd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e728c592-21bd-4dc6-a232-66c52c465dec", "name": "network-vif-deleted", "tag": "ad371e3b-52c5-4c5f-be12-8b115d8d31ea"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:31.518478 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-a5902db8-b471-4308-8072-cc3098ca7274 req-4cd8969c-5dd3-445a-b5ea-11a31761ffd3 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:31.518953 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-a5902db8-b471-4308-8072-cc3098ca7274 req-4cd8969c-5dd3-445a-b5ea-11a31761ffd3 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:31.530028 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-a5902db8-b471-4308-8072-cc3098ca7274 req-4cd8969c-5dd3-445a-b5ea-11a31761ffd3 service nova] Creating event network-vif-deleted:ad371e3b-52c5-4c5f-be12-8b115d8d31ea for instance e728c592-21bd-4dc6-a232-66c52c465dec on hv-cinder-84067 May 09 23:07:31.535630 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-a5902db8-b471-4308-8072-cc3098ca7274 req-4cd8969c-5dd3-445a-b5ea-11a31761ffd3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031073 May 09 23:07:31.536738 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 301/611] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:31.717076 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c044641f-92f7-4a20-a769-a4de57030fe3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:31.718173 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c044641f-92f7-4a20-a769-a4de57030fe3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:31.725323 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c044641f-92f7-4a20-a769-a4de57030fe3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:31.725914 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c044641f-92f7-4a20-a769-a4de57030fe3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:31.726739 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c044641f-92f7-4a20-a769-a4de57030fe3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:31.727200 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c044641f-92f7-4a20-a769-a4de57030fe3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:31.758212 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c044641f-92f7-4a20-a769-a4de57030fe3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045136 May 09 23:07:31.763913 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 311/612] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:07:31 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 23:07:31.830266 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9588d4c7-cc98-47c8-a837-b0224db44c9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:31.831193 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9588d4c7-cc98-47c8-a837-b0224db44c9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:31.838414 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9588d4c7-cc98-47c8-a837-b0224db44c9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:31.838955 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9588d4c7-cc98-47c8-a837-b0224db44c9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:31.839901 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9588d4c7-cc98-47c8-a837-b0224db44c9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:31.840465 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9588d4c7-cc98-47c8-a837-b0224db44c9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:31.852207 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-45d26afe-4426-4a5f-8c4f-d62817c16388 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:31.857004 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-45d26afe-4426-4a5f-8c4f-d62817c16388 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:31.868725 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9588d4c7-cc98-47c8-a837-b0224db44c9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Going to try to terminate instance {{(pid=117142) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:07:31.872015 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-45d26afe-4426-4a5f-8c4f-d62817c16388 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:31.872807 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-45d26afe-4426-4a5f-8c4f-d62817c16388 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:31.874807 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-45d26afe-4426-4a5f-8c4f-d62817c16388 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:31.877049 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-45d26afe-4426-4a5f-8c4f-d62817c16388 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:31.924219 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-45d26afe-4426-4a5f-8c4f-d62817c16388 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:31.925127 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-45d26afe-4426-4a5f-8c4f-d62817c16388 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:31.925871 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.objects.instance [None req-45d26afe-4426-4a5f-8c4f-d62817c16388 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lazy-loading 'fault' on Instance uuid 93373b9f-f998-4983-9b08-7b874cf7c76e {{(pid=117143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:07:31.956995 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9588d4c7-cc98-47c8-a837-b0224db44c9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 204 len: 0 microversion: 2.1 time: 0.130996 May 09 23:07:31.957884 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 302/613] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:07:31 2022] DELETE /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:07:31.966649 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-6760f2e4-0917-4bc0-a8ca-6b4bd5abd312 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:31.967552 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-6760f2e4-0917-4bc0-a8ca-6b4bd5abd312 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:31.972932 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-45d26afe-4426-4a5f-8c4f-d62817c16388 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbe84526dd48a6be14c1aebf5713c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df4f41ba52453dabfd21f82cb9238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:31.975323 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6760f2e4-0917-4bc0-a8ca-6b4bd5abd312 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:31.975783 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6760f2e4-0917-4bc0-a8ca-6b4bd5abd312 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:31.976569 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6760f2e4-0917-4bc0-a8ca-6b4bd5abd312 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:31.977004 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6760f2e4-0917-4bc0-a8ca-6b4bd5abd312 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:31.981867 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-45d26afe-4426-4a5f-8c4f-d62817c16388 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 200 len: 1349 microversion: 2.1 time: 0.133564 May 09 23:07:31.982508 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 312/614] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:31 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 1349 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:32.111668 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-6760f2e4-0917-4bc0-a8ca-6b4bd5abd312 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:32.119101 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-6760f2e4-0917-4bc0-a8ca-6b4bd5abd312 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1684 microversion: 2.1 time: 0.156764 May 09 23:07:32.119683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 303/615] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:31 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:07:32.434143 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b4ca9a74-451f-48f9-a0a7-e80914190df0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:32.434677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b4ca9a74-451f-48f9-a0a7-e80914190df0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:32.440604 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b4ca9a74-451f-48f9-a0a7-e80914190df0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:32.441052 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b4ca9a74-451f-48f9-a0a7-e80914190df0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:32.441807 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b4ca9a74-451f-48f9-a0a7-e80914190df0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:32.442648 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b4ca9a74-451f-48f9-a0a7-e80914190df0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:32.472744 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b4ca9a74-451f-48f9-a0a7-e80914190df0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:32.473188 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b4ca9a74-451f-48f9-a0a7-e80914190df0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:32.473627 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.objects.instance [None req-b4ca9a74-451f-48f9-a0a7-e80914190df0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lazy-loading 'fault' on Instance uuid e728c592-21bd-4dc6-a232-66c52c465dec {{(pid=117143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:07:32.516210 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b4ca9a74-451f-48f9-a0a7-e80914190df0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:32.523300 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b4ca9a74-451f-48f9-a0a7-e80914190df0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1312 microversion: 2.1 time: 0.093214 May 09 23:07:32.523865 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 313/616] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:32 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:32.999242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f681fc00-5cdf-4775-84f0-8b943541fe46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:33.000475 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f681fc00-5cdf-4775-84f0-8b943541fe46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] [instance: 93373b9f-f998-4983-9b08-7b874cf7c76e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:33.006874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f681fc00-5cdf-4775-84f0-8b943541fe46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:33.007327 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f681fc00-5cdf-4775-84f0-8b943541fe46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:33.008096 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f681fc00-5cdf-4775-84f0-8b943541fe46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:33.008533 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f681fc00-5cdf-4775-84f0-8b943541fe46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:33.021325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-f681fc00-5cdf-4775-84f0-8b943541fe46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] HTTP exception thrown: Instance 93373b9f-f998-4983-9b08-7b874cf7c76e could not be found. May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f681fc00-5cdf-4775-84f0-8b943541fe46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Request method failure captured: May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e HTTP/1.1 May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ3whPR8Pl-5BsaA6uHzmnkCA7fqz8y9XVnoW30w5BU2P8GWLvyUK1J6vpCAqNDI6FmBWXhWkEGA0-holkyb9n7pc44kweTLRspnauFhkfvAsAWsRSkimO8hmgzRb8wurXwsebkZwkIWmHdLPgcVn5HCdRIy_PfYDg9-W9ZN8MtsfWI May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: 93df4f41ba52453dabfd21f82cb9238b May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-TestMinimumBasicScenario-1147938025 May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:07:33.022948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:07:33.024426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/93df4f41ba52453dabfd21f82cb9238b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_93df4f41ba52453dabfd21f82cb9238b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/93df4f41ba52453dabfd21f82cb9238b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/93df4f41ba52453dabfd21f82cb9238b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:07:33.024426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-TestMinimumBasicScenario-1147938025 May 09 23:07:33.024426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: 93df4f41ba52453dabfd21f82cb9238b May 09 23:07:33.024426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1147938025 May 09 23:07:33.024426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-TestMinimumBasicScenario-1147938025-project May 09 23:07:33.024426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:07:33.024426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:07:33.024426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 19fbe84526dd48a6be14c1aebf5713c0 May 09 23:07:33.024426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-TestMinimumBasicScenario-1147938025-project May 09 23:07:33.024426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:07:33.024426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 93373b9f-f998-4983-9b08-7b874cf7c76e could not be found. May 09 23:07:33.024426 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '93373b9f-f998-4983-9b08-7b874cf7c76e'} May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93373b9f-f998-4983-9b08-7b874cf7c76e could not be found. May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:07:33.025277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93373b9f-f998-4983-9b08-7b874cf7c76e could not be found. May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93373b9f-f998-4983-9b08-7b874cf7c76e could not be found. May 09 23:07:33.026709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:33.027995 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f681fc00-5cdf-4775-84f0-8b943541fe46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Returning 404 to user: Instance 93373b9f-f998-4983-9b08-7b874cf7c76e could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:07:33.027995 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f681fc00-5cdf-4775-84f0-8b943541fe46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e" status: 404 len: 111 microversion: 2.1 time: 0.028893 May 09 23:07:33.027995 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 304/617] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:32 2022] GET /compute/v2.1/servers/93373b9f-f998-4983-9b08-7b874cf7c76e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:07:33.033448 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6360e13f-6de2-405e-be7a-05dc003b0a46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] Calling method '.version_select at 0x7fc2983c9790>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:33.051624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6360e13f-6de2-405e-be7a-05dc003b0a46 tempest-TestMinimumBasicScenario-1147938025 tempest-TestMinimumBasicScenario-1147938025-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2109316223" status: 202 len: 0 microversion: 2.1 time: 0.022587 May 09 23:07:33.052183 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 314/618] 10.222.0.23 () {58 vars in 1271 bytes} [Mon May 9 23:07:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2109316223 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:07:33.136751 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-935637ed-a186-4f70-9295-d50903e37067 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:33.137398 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-935637ed-a186-4f70-9295-d50903e37067 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:33.143252 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-935637ed-a186-4f70-9295-d50903e37067 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:33.143712 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-935637ed-a186-4f70-9295-d50903e37067 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:33.144484 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-935637ed-a186-4f70-9295-d50903e37067 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:33.144922 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-935637ed-a186-4f70-9295-d50903e37067 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:33.281900 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-935637ed-a186-4f70-9295-d50903e37067 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:33.289262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-935637ed-a186-4f70-9295-d50903e37067 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1684 microversion: 2.1 time: 0.156436 May 09 23:07:33.289927 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 305/619] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:33 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:33.540371 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-dadfa758-0b72-408b-82e1-b2fbfa85cce9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:33.540904 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-dadfa758-0b72-408b-82e1-b2fbfa85cce9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:33.546897 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dadfa758-0b72-408b-82e1-b2fbfa85cce9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:33.547348 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dadfa758-0b72-408b-82e1-b2fbfa85cce9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:33.548115 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dadfa758-0b72-408b-82e1-b2fbfa85cce9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:33.548548 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dadfa758-0b72-408b-82e1-b2fbfa85cce9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:33.585978 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dadfa758-0b72-408b-82e1-b2fbfa85cce9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:33.586460 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dadfa758-0b72-408b-82e1-b2fbfa85cce9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:33.586918 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.objects.instance [None req-dadfa758-0b72-408b-82e1-b2fbfa85cce9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lazy-loading 'fault' on Instance uuid e728c592-21bd-4dc6-a232-66c52c465dec {{(pid=117143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:07:33.639608 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-dadfa758-0b72-408b-82e1-b2fbfa85cce9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:33.648767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-dadfa758-0b72-408b-82e1-b2fbfa85cce9 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 200 len: 1312 microversion: 2.1 time: 0.112495 May 09 23:07:33.651000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 315/620] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:33 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:34.307670 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f7fae3d2-aa1b-4105-9099-fc9b9feaa354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:34.308402 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f7fae3d2-aa1b-4105-9099-fc9b9feaa354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:34.315727 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f7fae3d2-aa1b-4105-9099-fc9b9feaa354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:34.316251 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f7fae3d2-aa1b-4105-9099-fc9b9feaa354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:34.317086 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f7fae3d2-aa1b-4105-9099-fc9b9feaa354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:34.317585 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f7fae3d2-aa1b-4105-9099-fc9b9feaa354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:34.601725 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f7fae3d2-aa1b-4105-9099-fc9b9feaa354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:34.609365 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f7fae3d2-aa1b-4105-9099-fc9b9feaa354 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1684 microversion: 2.1 time: 0.306251 May 09 23:07:34.620511 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 306/621] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:34 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1684 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:34.666628 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-cb7990e9-353b-41a7-a19a-e983e7aab7a0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:34.667462 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-cb7990e9-353b-41a7-a19a-e983e7aab7a0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: e728c592-21bd-4dc6-a232-66c52c465dec] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:34.674296 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cb7990e9-353b-41a7-a19a-e983e7aab7a0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:34.674854 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cb7990e9-353b-41a7-a19a-e983e7aab7a0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:34.675730 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cb7990e9-353b-41a7-a19a-e983e7aab7a0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:34.676265 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-cb7990e9-353b-41a7-a19a-e983e7aab7a0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:34.690946 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-cb7990e9-353b-41a7-a19a-e983e7aab7a0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] HTTP exception thrown: Instance e728c592-21bd-4dc6-a232-66c52c465dec could not be found. May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-cb7990e9-353b-41a7-a19a-e983e7aab7a0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Request method failure captured: May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec HTTP/1.1 May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ2FFz9vnmF8wAewdVUSwImcpsQ_FwsT9_7-H0Toz28qyLF5raYcR0RdwhQ7DcuMUUb6fbU3N9fxJ3lqVbGJA-eSv-tQlbFOPaZxX5sJAbjs8F6A88WSsbHqIz7xSQ8sIzcyDrkQNCaIK1p8i0U8DUR4GQ-9BgcmVdUyMXRTEAlwBLw May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 0cb055ff9f0d4af6962070c7a2f19bf3 May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:07:34.692784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:07:34.694406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:07:34.694406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:07:34.694406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 0cb055ff9f0d4af6962070c7a2f19bf3 May 09 23:07:34.694406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:07:34.694406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-ServerRescueNegativeTestJSON-345311633-project May 09 23:07:34.694406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:07:34.694406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:07:34.694406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: e41b4feaa9be44e89210b70c19ef10ab May 09 23:07:34.694406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-ServerRescueNegativeTestJSON-345311633-project May 09 23:07:34.694406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:07:34.694406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance e728c592-21bd-4dc6-a232-66c52c465dec could not be found. May 09 23:07:34.694406 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': 'e728c592-21bd-4dc6-a232-66c52c465dec'} May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e728c592-21bd-4dc6-a232-66c52c465dec could not be found. May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:07:34.695277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e728c592-21bd-4dc6-a232-66c52c465dec could not be found. May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e728c592-21bd-4dc6-a232-66c52c465dec could not be found. May 09 23:07:34.696624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:07:34.697863 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-cb7990e9-353b-41a7-a19a-e983e7aab7a0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Returning 404 to user: Instance e728c592-21bd-4dc6-a232-66c52c465dec could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:07:34.698770 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-cb7990e9-353b-41a7-a19a-e983e7aab7a0 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec" status: 404 len: 111 microversion: 2.1 time: 0.036270 May 09 23:07:34.699419 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 316/622] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:34 2022] GET /compute/v2.1/servers/e728c592-21bd-4dc6-a232-66c52c465dec => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:07:34.710107 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-77ad6aaa-6b56-4169-9a87-41c8bc6554e5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:34.710688 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-77ad6aaa-6b56-4169-9a87-41c8bc6554e5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:34.716866 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-77ad6aaa-6b56-4169-9a87-41c8bc6554e5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:34.717322 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-77ad6aaa-6b56-4169-9a87-41c8bc6554e5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:34.718087 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-77ad6aaa-6b56-4169-9a87-41c8bc6554e5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:34.718612 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-77ad6aaa-6b56-4169-9a87-41c8bc6554e5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:34.746769 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-77ad6aaa-6b56-4169-9a87-41c8bc6554e5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Going to try to terminate instance {{(pid=117142) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:07:34.849644 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-77ad6aaa-6b56-4169-9a87-41c8bc6554e5 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 204 len: 0 microversion: 2.1 time: 0.142698 May 09 23:07:34.853124 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 307/623] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:07:34 2022] DELETE /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:07:34.858902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-01edf7de-d12c-435c-8854-98107404303b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:34.859830 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-01edf7de-d12c-435c-8854-98107404303b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:34.872251 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-01edf7de-d12c-435c-8854-98107404303b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:34.872912 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-01edf7de-d12c-435c-8854-98107404303b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:34.874048 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-8e0ecd99-875e-4f7a-884a-88c541a9f3b9 req-b41f9a72-cf0e-4580-822b-d38920cb04d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ea1b8e-49ff-4716-8cbf-ca11225258aa", "name": "network-vif-deleted", "tag": "49e0cd49-aaf5-4ce6-b0b4-5c7345fa279e"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:34.874345 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-01edf7de-d12c-435c-8854-98107404303b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:34.875487 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-01edf7de-d12c-435c-8854-98107404303b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:34.884021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-8e0ecd99-875e-4f7a-884a-88c541a9f3b9 req-b41f9a72-cf0e-4580-822b-d38920cb04d0 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:34.884773 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-8e0ecd99-875e-4f7a-884a-88c541a9f3b9 req-b41f9a72-cf0e-4580-822b-d38920cb04d0 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:34.897754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-8e0ecd99-875e-4f7a-884a-88c541a9f3b9 req-b41f9a72-cf0e-4580-822b-d38920cb04d0 service nova] Creating event network-vif-deleted:49e0cd49-aaf5-4ce6-b0b4-5c7345fa279e for instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa on hv-cinder-84067 May 09 23:07:34.903689 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-8e0ecd99-875e-4f7a-884a-88c541a9f3b9 req-b41f9a72-cf0e-4580-822b-d38920cb04d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034384 May 09 23:07:34.904910 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 308/624] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:35.047593 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-01edf7de-d12c-435c-8854-98107404303b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:35.063453 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-01edf7de-d12c-435c-8854-98107404303b tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.203667 May 09 23:07:35.064663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 317/625] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:34 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:35.628806 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-2737014b-7b7c-4ef6-a592-755e571c5bd9 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:35.629511 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-2737014b-7b7c-4ef6-a592-755e571c5bd9 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:35.639413 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2737014b-7b7c-4ef6-a592-755e571c5bd9 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:35.639867 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2737014b-7b7c-4ef6-a592-755e571c5bd9 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:35.641233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2737014b-7b7c-4ef6-a592-755e571c5bd9 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:35.641671 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2737014b-7b7c-4ef6-a592-755e571c5bd9 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:35.750530 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-2737014b-7b7c-4ef6-a592-755e571c5bd9 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:35.763900 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-2737014b-7b7c-4ef6-a592-755e571c5bd9 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1616 microversion: 2.1 time: 0.139843 May 09 23:07:35.775737 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 309/626] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:35 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1616 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:36.080682 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-9e01f42f-37d6-4405-9ad2-efabfefb0dfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:36.081292 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-9e01f42f-37d6-4405-9ad2-efabfefb0dfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:36.088021 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9e01f42f-37d6-4405-9ad2-efabfefb0dfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:36.088491 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9e01f42f-37d6-4405-9ad2-efabfefb0dfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:36.089267 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9e01f42f-37d6-4405-9ad2-efabfefb0dfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:36.089707 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9e01f42f-37d6-4405-9ad2-efabfefb0dfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:36.222904 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-9e01f42f-37d6-4405-9ad2-efabfefb0dfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:36.230157 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-9e01f42f-37d6-4405-9ad2-efabfefb0dfd tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.153376 May 09 23:07:36.230728 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 318/627] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:36 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:36.782019 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5ea1c974-5b13-415e-9ec4-da2723d94062 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:36.782635 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5ea1c974-5b13-415e-9ec4-da2723d94062 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:36.789215 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5ea1c974-5b13-415e-9ec4-da2723d94062 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:36.789669 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5ea1c974-5b13-415e-9ec4-da2723d94062 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:36.790492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5ea1c974-5b13-415e-9ec4-da2723d94062 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:36.790929 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5ea1c974-5b13-415e-9ec4-da2723d94062 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:36.858489 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5ea1c974-5b13-415e-9ec4-da2723d94062 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:36.867814 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5ea1c974-5b13-415e-9ec4-da2723d94062 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1616 microversion: 2.1 time: 0.090152 May 09 23:07:36.868709 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 310/628] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:36 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1616 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:37.248876 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e5d306f4-c96c-4957-967b-1d1447d2b592 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:37.250163 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e5d306f4-c96c-4957-967b-1d1447d2b592 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:37.257269 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e5d306f4-c96c-4957-967b-1d1447d2b592 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:37.258025 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e5d306f4-c96c-4957-967b-1d1447d2b592 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:37.259027 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e5d306f4-c96c-4957-967b-1d1447d2b592 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:37.259466 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e5d306f4-c96c-4957-967b-1d1447d2b592 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:37.505805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e5d306f4-c96c-4957-967b-1d1447d2b592 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:37.513168 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e5d306f4-c96c-4957-967b-1d1447d2b592 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.268706 May 09 23:07:37.513737 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 319/629] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:37 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:37.884292 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fc335bf5-8b11-481c-9767-58bce2aca3b2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:37.884901 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-fc335bf5-8b11-481c-9767-58bce2aca3b2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:37.891353 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fc335bf5-8b11-481c-9767-58bce2aca3b2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:37.891810 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fc335bf5-8b11-481c-9767-58bce2aca3b2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:37.892577 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fc335bf5-8b11-481c-9767-58bce2aca3b2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:37.893015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fc335bf5-8b11-481c-9767-58bce2aca3b2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:37.955711 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-fc335bf5-8b11-481c-9767-58bce2aca3b2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:37.965773 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-fc335bf5-8b11-481c-9767-58bce2aca3b2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 200 len: 1616 microversion: 2.1 time: 0.085029 May 09 23:07:37.966640 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 311/630] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:37 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 1616 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:38.530037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7461819c-29b1-4c2b-bbe3-ed49f50a9e24 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:38.531418 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7461819c-29b1-4c2b-bbe3-ed49f50a9e24 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:38.539313 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7461819c-29b1-4c2b-bbe3-ed49f50a9e24 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:38.540030 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7461819c-29b1-4c2b-bbe3-ed49f50a9e24 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:38.541010 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7461819c-29b1-4c2b-bbe3-ed49f50a9e24 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:38.541650 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7461819c-29b1-4c2b-bbe3-ed49f50a9e24 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:38.984036 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-dfca5305-8a12-40cf-9691-8c398a2bd1dd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:38.984683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-dfca5305-8a12-40cf-9691-8c398a2bd1dd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:38.990931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-dfca5305-8a12-40cf-9691-8c398a2bd1dd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:38.991375 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-dfca5305-8a12-40cf-9691-8c398a2bd1dd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:38.992128 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-dfca5305-8a12-40cf-9691-8c398a2bd1dd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:38.992556 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-dfca5305-8a12-40cf-9691-8c398a2bd1dd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:39.006050 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-dfca5305-8a12-40cf-9691-8c398a2bd1dd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] HTTP exception thrown: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-dfca5305-8a12-40cf-9691-8c398a2bd1dd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Request method failure captured: May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa HTTP/1.1 May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ2AZq5EfNRX4A2tCiVwicbnfgrKkrL1gKGZ2i9kDkpeQEVnPD6CHxNPMLHcnk-nNrqb42O05Dml9fFcVJ8tZC-e8-FzgQMzIs0cjdHVhCDJH8lgSgXK8gUI8fFy_4mLaumbFrU7L_T2O0x7fdFRFsthOIPJ0V_6K6OxmafCQoxWJqE May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:07:39.007708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:07:39.009212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b776734a879d4c0785b1d3728b79b766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:07:39.009212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:07:39.009212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:07:39.009212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:07:39.009212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:07:39.009212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:07:39.009212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:07:39.009212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 84a45506c19c4cda8173c164a097f925 May 09 23:07:39.009212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:07:39.009212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:07:39.009212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:07:39.009212 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '31ea1b8e-49ff-4716-8cbf-ca11225258aa'} May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:07:39.010060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:07:39.011479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:39.012726 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-dfca5305-8a12-40cf-9691-8c398a2bd1dd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Returning 404 to user: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:07:39.012726 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-dfca5305-8a12-40cf-9691-8c398a2bd1dd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 404 len: 111 microversion: 2.1 time: 0.029135 May 09 23:07:39.012726 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 312/631] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:38 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 23:07:39.022536 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c069be3b-611a-44a2-b9f0-d8b56ec1d619 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '.version_select at 0x7fc28ba7f5e0>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:39.041436 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c069be3b-611a-44a2-b9f0-d8b56ec1d619 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1095955096" status: 202 len: 0 microversion: 2.1 time: 0.022398 May 09 23:07:39.042052 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 313/632] 10.222.0.23 () {58 vars in 1220 bytes} [Mon May 9 23:07:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1095955096 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 23:07:39.094666 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7461819c-29b1-4c2b-bbe3-ed49f50a9e24 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b4feaa9be44e89210b70c19ef10ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb055ff9f0d4af6962070c7a2f19bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:39.102904 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7461819c-29b1-4c2b-bbe3-ed49f50a9e24 tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 200 len: 1521 microversion: 2.1 time: 0.576733 May 09 23:07:39.103568 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 320/633] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:38 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:39.540205 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-7aede5f5-92c3-4c81-b414-c937e357eca7 req-6cbba517-6026-4931-a262-2688268f50c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7", "name": "network-vif-deleted", "tag": "a155ecdb-d89b-4868-8cb1-49548f3d778f"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:39.549412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-7aede5f5-92c3-4c81-b414-c937e357eca7 req-6cbba517-6026-4931-a262-2688268f50c5 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:39.549964 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-7aede5f5-92c3-4c81-b414-c937e357eca7 req-6cbba517-6026-4931-a262-2688268f50c5 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:39.560477 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-7aede5f5-92c3-4c81-b414-c937e357eca7 req-6cbba517-6026-4931-a262-2688268f50c5 service nova] Creating event network-vif-deleted:a155ecdb-d89b-4868-8cb1-49548f3d778f for instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 on hv-cinder-84067 May 09 23:07:39.568033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-7aede5f5-92c3-4c81-b414-c937e357eca7 req-6cbba517-6026-4931-a262-2688268f50c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030974 May 09 23:07:39.568487 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 314/634] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:39.700119 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7005cd53-15b6-485d-9f65-0861ac215657 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Action: 'create', calling method: .version_select at 0x7fc298177310>, body: {"keypair": {"name": "tempest-keypair-751187037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz5aALrtvdXXwXDpgJJehLeQ5BCYLwCE0oNW5jMQAjZ2pgqykHT495hnu0Oirhq3LhlB2bWt0tbdmVVFhZNDJvK9l9rzXRBeFEhu1BhSZlRoIAss3AfL4/yu+hpJJv9AA=="}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:39.715934 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-7005cd53-15b6-485d-9f65-0861ac215657 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for project b776734a879d4c0785b1d3728b79b766. Resources: {'key_pairs'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:07:39.721044 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-7005cd53-15b6-485d-9f65-0861ac215657 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for user 84a45506c19c4cda8173c164a097f925 and project b776734a879d4c0785b1d3728b79b766. Resources: {'key_pairs'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:07:39.744948 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7005cd53-15b6-485d-9f65-0861ac215657 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048564 May 09 23:07:39.746386 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 321/635] 10.222.0.23 () {60 vars in 1158 bytes} [Mon May 9 23:07:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:40.123432 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-83a86124-a811-4bcd-816f-632c4f7b1a0e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:40.124140 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-83a86124-a811-4bcd-816f-632c4f7b1a0e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] [instance: ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:40.133308 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-83a86124-a811-4bcd-816f-632c4f7b1a0e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:40.133756 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-83a86124-a811-4bcd-816f-632c4f7b1a0e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:40.134607 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-83a86124-a811-4bcd-816f-632c4f7b1a0e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:40.135046 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-83a86124-a811-4bcd-816f-632c4f7b1a0e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:40.153093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-83a86124-a811-4bcd-816f-632c4f7b1a0e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] HTTP exception thrown: Instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 could not be found. May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-83a86124-a811-4bcd-816f-632c4f7b1a0e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Request method failure captured: May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 HTTP/1.1 May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ2FFz9vnmF8wAewdVUSwImcpsQ_FwsT9_7-H0Toz28qyLF5raYcR0RdwhQ7DcuMUUb6fbU3N9fxJ3lqVbGJA-eSv-tQlbFOPaZxX5sJAbjs8F6A88WSsbHqIz7xSQ8sIzcyDrkQNCaIK1p8i0U8DUR4GQ-9BgcmVdUyMXRTEAlwBLw May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: 0cb055ff9f0d4af6962070c7a2f19bf3 May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:07:40.155429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:07:40.157521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0cb055ff9f0d4af6962070c7a2f19bf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:07:40.157521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:07:40.157521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: 0cb055ff9f0d4af6962070c7a2f19bf3 May 09 23:07:40.157521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-345311633 May 09 23:07:40.157521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-ServerRescueNegativeTestJSON-345311633-project May 09 23:07:40.157521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:07:40.157521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:07:40.157521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: e41b4feaa9be44e89210b70c19ef10ab May 09 23:07:40.157521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-ServerRescueNegativeTestJSON-345311633-project May 09 23:07:40.157521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:07:40.157521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 could not be found. May 09 23:07:40.157521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': 'ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7'} May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 could not be found. May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:07:40.158399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 could not be found. May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 could not be found. May 09 23:07:40.159687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:07:40.161851 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-83a86124-a811-4bcd-816f-632c4f7b1a0e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] Returning 404 to user: Instance ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:07:40.163132 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-83a86124-a811-4bcd-816f-632c4f7b1a0e tempest-ServerRescueNegativeTestJSON-345311633 tempest-ServerRescueNegativeTestJSON-345311633-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7" status: 404 len: 111 microversion: 2.1 time: 0.045468 May 09 23:07:40.164170 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 315/636] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:40 2022] GET /compute/v2.1/servers/ee4d6ed8-3ee1-4d07-895e-43097ba3e2e7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:07:42.208445 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1102084009", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8d1714e-6adf-478e-9341-0aabd043adfd"}], "security_groups": [{"name": "tempest-securitygroup--1860571765"}], "key_name": "tempest-keypair-751187037", "user_data": "}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:42.379961 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.network.neutron [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] validate_networks() for [('a8d1714e-6adf-478e-9341-0aabd043adfd', None, None, None, None, None)] {{(pid=117143) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:07:43.144587 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Flavor limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:07:43.145021 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Image limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:07:43.145486 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Flavor pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:07:43.147163 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Image pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:07:43.147583 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:07:43.158440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:43.159264 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:43.159607 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:43.160041 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:43.177573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for project b776734a879d4c0785b1d3728b79b766. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:07:43.181493 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Getting quotas for user 84a45506c19c4cda8173c164a097f925 and project b776734a879d4c0785b1d3728b79b766. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:07:43.192443 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Going to run 1 instances... {{(pid=117143) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:07:43.194722 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:07:43.244835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a1fa7333-2d29-4850-9c4d-9def3c23197e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.041345 May 09 23:07:43.245482 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 322/637] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:07:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 09 23:07:43.255669 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cf6944b3-d9f8-450e-a854-e4d6a4e57058 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:43.256887 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cf6944b3-d9f8-450e-a854-e4d6a4e57058 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:43.323226 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cf6944b3-d9f8-450e-a854-e4d6a4e57058 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:43.330447 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cf6944b3-d9f8-450e-a854-e4d6a4e57058 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 200 len: 1241 microversion: 2.1 time: 0.078590 May 09 23:07:43.331638 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 316/638] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:43 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:44.352439 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-28b1eee5-4600-4296-a3a7-8a34d395bd14 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:44.355055 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-28b1eee5-4600-4296-a3a7-8a34d395bd14 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:44.362354 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-28b1eee5-4600-4296-a3a7-8a34d395bd14 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:44.363107 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-28b1eee5-4600-4296-a3a7-8a34d395bd14 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:44.364100 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-28b1eee5-4600-4296-a3a7-8a34d395bd14 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:44.364873 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-28b1eee5-4600-4296-a3a7-8a34d395bd14 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:44.500273 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-28b1eee5-4600-4296-a3a7-8a34d395bd14 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:44.508487 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-28b1eee5-4600-4296-a3a7-8a34d395bd14 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 200 len: 1301 microversion: 2.1 time: 0.165433 May 09 23:07:44.510805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 323/639] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:44 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 1301 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:45.528230 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9c8d18e0-2e7d-4e74-989c-a9231ffce8c4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:45.528989 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9c8d18e0-2e7d-4e74-989c-a9231ffce8c4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:45.536549 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9c8d18e0-2e7d-4e74-989c-a9231ffce8c4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:45.537236 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9c8d18e0-2e7d-4e74-989c-a9231ffce8c4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:45.538416 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9c8d18e0-2e7d-4e74-989c-a9231ffce8c4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:45.539229 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9c8d18e0-2e7d-4e74-989c-a9231ffce8c4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:45.688684 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-9c8d18e0-2e7d-4e74-989c-a9231ffce8c4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:45.696210 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9c8d18e0-2e7d-4e74-989c-a9231ffce8c4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 200 len: 1367 microversion: 2.1 time: 0.172368 May 09 23:07:45.697009 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 317/640] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:45 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:46.032665 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-2bc4660a-4667-4d5e-83d4-52afcb52f801 req-22d3a8f1-b366-4a80-b597-d9bcd371f899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "791da3e3-267a-4bdd-9761-386c1061811e", "tag": "79d9a4b3-de1a-4fc9-bd91-29fa1550dc38"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:46.054417 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-2bc4660a-4667-4d5e-83d4-52afcb52f801 req-22d3a8f1-b366-4a80-b597-d9bcd371f899 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:46.055119 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-2bc4660a-4667-4d5e-83d4-52afcb52f801 req-22d3a8f1-b366-4a80-b597-d9bcd371f899 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:46.068464 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-2bc4660a-4667-4d5e-83d4-52afcb52f801 req-22d3a8f1-b366-4a80-b597-d9bcd371f899 service nova] Creating event network-changed:79d9a4b3-de1a-4fc9-bd91-29fa1550dc38 for instance 791da3e3-267a-4bdd-9761-386c1061811e on hv-cinder-84067 May 09 23:07:46.075246 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-2bc4660a-4667-4d5e-83d4-52afcb52f801 req-22d3a8f1-b366-4a80-b597-d9bcd371f899 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053957 May 09 23:07:46.076139 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 324/641] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:46.712935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-bc58923d-7926-4884-9353-a030270468da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:46.713566 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-bc58923d-7926-4884-9353-a030270468da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:46.720101 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bc58923d-7926-4884-9353-a030270468da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:46.720553 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bc58923d-7926-4884-9353-a030270468da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:46.721372 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bc58923d-7926-4884-9353-a030270468da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:46.721843 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bc58923d-7926-4884-9353-a030270468da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:46.972483 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-bc58923d-7926-4884-9353-a030270468da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:46.980831 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-bc58923d-7926-4884-9353-a030270468da tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 200 len: 1367 microversion: 2.1 time: 0.271710 May 09 23:07:46.982005 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 318/642] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:46 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:07:48.006205 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0d6e8742-8a87-49b5-80e7-2f7934116414 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:48.006853 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-0d6e8742-8a87-49b5-80e7-2f7934116414 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:48.015438 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0d6e8742-8a87-49b5-80e7-2f7934116414 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:48.015892 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0d6e8742-8a87-49b5-80e7-2f7934116414 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:48.016709 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0d6e8742-8a87-49b5-80e7-2f7934116414 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:48.017147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0d6e8742-8a87-49b5-80e7-2f7934116414 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:48.156708 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-0d6e8742-8a87-49b5-80e7-2f7934116414 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:48.163990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-0d6e8742-8a87-49b5-80e7-2f7934116414 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 200 len: 1367 microversion: 2.1 time: 0.168716 May 09 23:07:48.164560 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 325/643] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:47 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:49.180955 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0513a7d1-cee4-4deb-9627-8efb9fc6d895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:49.190056 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-0513a7d1-cee4-4deb-9627-8efb9fc6d895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:49.198044 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0513a7d1-cee4-4deb-9627-8efb9fc6d895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:49.198842 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0513a7d1-cee4-4deb-9627-8efb9fc6d895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:49.199846 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0513a7d1-cee4-4deb-9627-8efb9fc6d895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:49.200454 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0513a7d1-cee4-4deb-9627-8efb9fc6d895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:49.355477 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-0513a7d1-cee4-4deb-9627-8efb9fc6d895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:49.366075 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0513a7d1-cee4-4deb-9627-8efb9fc6d895 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 200 len: 1367 microversion: 2.1 time: 0.188984 May 09 23:07:49.377620 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 319/644] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:49 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:50.383691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c2e0a05a-6701-4fd6-a8ca-61743995c564 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:50.384473 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c2e0a05a-6701-4fd6-a8ca-61743995c564 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:50.392593 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c2e0a05a-6701-4fd6-a8ca-61743995c564 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:50.393295 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c2e0a05a-6701-4fd6-a8ca-61743995c564 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:50.394309 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c2e0a05a-6701-4fd6-a8ca-61743995c564 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:50.394909 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c2e0a05a-6701-4fd6-a8ca-61743995c564 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:50.532167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c2e0a05a-6701-4fd6-a8ca-61743995c564 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:50.541262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c2e0a05a-6701-4fd6-a8ca-61743995c564 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 200 len: 1367 microversion: 2.1 time: 0.161831 May 09 23:07:50.541921 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 326/645] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:50 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:07:50.554421 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-b5164ed8-0eb4-4ae6-844d-77e27f42507e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Action: 'create', calling method: .version_select at 0x7fc28bb3c8b0>, body: {"keypair": {"name": "tempest-keypair-454659132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPnNexLWCZ6wPiCz+56fiFSKNCiu2uVEXn86R1T9OUuL4Flnwn0K7QGw2Z2hTy2N3v92bwWbAfitKKnCYSoKQEvTtbZWDkiXbucrHAVDBoByl2I2O5cnp5KbKvDJ60CEg=="}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:50.568714 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-b5164ed8-0eb4-4ae6-844d-77e27f42507e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Getting quotas for project c0df002b4f614f4bbac1782e1fbb484a. Resources: {'key_pairs'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:07:50.573723 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-b5164ed8-0eb4-4ae6-844d-77e27f42507e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Getting quotas for user 1de1f7ce5e5f4cfbb283f0c79d87f9c8 and project c0df002b4f614f4bbac1782e1fbb484a. Resources: {'key_pairs'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:07:50.599132 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-b5164ed8-0eb4-4ae6-844d-77e27f42507e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.169968 May 09 23:07:50.599821 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 320/646] 10.222.0.23 () {60 vars in 1158 bytes} [Mon May 9 23:07:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:07:51.269110 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-c8c89d2e-b22b-4e73-9414-1055ac3e2802 req-bc1c98e1-2aa1-489c-aaf8-16bf2ff5df40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791da3e3-267a-4bdd-9761-386c1061811e", "name": "network-vif-plugged", "status": "completed", "tag": "79d9a4b3-de1a-4fc9-bd91-29fa1550dc38"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:51.277435 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-c8c89d2e-b22b-4e73-9414-1055ac3e2802 req-bc1c98e1-2aa1-489c-aaf8-16bf2ff5df40 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:51.277978 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-c8c89d2e-b22b-4e73-9414-1055ac3e2802 req-bc1c98e1-2aa1-489c-aaf8-16bf2ff5df40 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:51.300042 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-c8c89d2e-b22b-4e73-9414-1055ac3e2802 req-bc1c98e1-2aa1-489c-aaf8-16bf2ff5df40 service nova] Creating event network-vif-plugged:79d9a4b3-de1a-4fc9-bd91-29fa1550dc38 for instance 791da3e3-267a-4bdd-9761-386c1061811e on hv-cinder-84067 May 09 23:07:51.305817 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-c8c89d2e-b22b-4e73-9414-1055ac3e2802 req-bc1c98e1-2aa1-489c-aaf8-16bf2ff5df40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040743 May 09 23:07:51.307925 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 327/647] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:51.559706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-933717c0-93a8-4da2-8e55-914efd4d9dc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:51.560981 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-933717c0-93a8-4da2-8e55-914efd4d9dc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:51.568902 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-933717c0-93a8-4da2-8e55-914efd4d9dc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:51.569644 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-933717c0-93a8-4da2-8e55-914efd4d9dc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:51.570725 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-933717c0-93a8-4da2-8e55-914efd4d9dc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:51.571381 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-933717c0-93a8-4da2-8e55-914efd4d9dc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:51.777468 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-933717c0-93a8-4da2-8e55-914efd4d9dc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:51.785756 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-933717c0-93a8-4da2-8e55-914efd4d9dc4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 200 len: 1367 microversion: 2.1 time: 0.231343 May 09 23:07:51.786480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 321/648] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:51 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:51.948488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-989151807", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "585983fb-4a68-4b82-b675-7c4ec5efad6e"}], "security_groups": [{"name": "tempest-securitygroup--10402261"}], "key_name": "tempest-keypair-454659132", "user_data": "}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:52.054814 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.network.neutron [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] validate_networks() for [('585983fb-4a68-4b82-b675-7c4ec5efad6e', None, None, None, None, None)] {{(pid=117143) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:07:52.408976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Flavor limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:07:52.409403 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Image limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:07:52.409885 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Flavor pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:07:52.410316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Image pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:07:52.410727 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:07:52.419725 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:52.420565 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:52.421728 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:52.422177 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:52.438586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Getting quotas for project c0df002b4f614f4bbac1782e1fbb484a. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:07:52.442903 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Getting quotas for user 1de1f7ce5e5f4cfbb283f0c79d87f9c8 and project c0df002b4f614f4bbac1782e1fbb484a. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:07:52.453794 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Going to run 1 instances... {{(pid=117143) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:07:52.456176 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:07:52.508225 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2eb409ea-b9dd-4464-87c0-a95f7f17bfec tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.564715 May 09 23:07:52.509540 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 328/649] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:07:51 2022] POST /compute/v2.1/servers => generated 400 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:07:52.522671 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5afc7be8-3378-4cbe-8c12-558bc3aa65da tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:52.523302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5afc7be8-3378-4cbe-8c12-558bc3aa65da tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:52.601433 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5afc7be8-3378-4cbe-8c12-558bc3aa65da tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:52.610514 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5afc7be8-3378-4cbe-8c12-558bc3aa65da tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1236 microversion: 2.1 time: 0.092881 May 09 23:07:52.620891 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 322/650] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:52 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1236 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:52.802802 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c87ad70b-8385-4935-a758-14ea93504bd6 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:52.803602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c87ad70b-8385-4935-a758-14ea93504bd6 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:52.812984 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c87ad70b-8385-4935-a758-14ea93504bd6 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:52.813738 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c87ad70b-8385-4935-a758-14ea93504bd6 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:52.814799 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c87ad70b-8385-4935-a758-14ea93504bd6 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:52.815381 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c87ad70b-8385-4935-a758-14ea93504bd6 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:52.992664 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c87ad70b-8385-4935-a758-14ea93504bd6 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:53.003918 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c87ad70b-8385-4935-a758-14ea93504bd6 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 200 len: 1367 microversion: 2.1 time: 0.205507 May 09 23:07:53.004565 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 329/651] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:52 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:53.635236 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-74286cec-4038-4e10-9ea6-e5a1842cc5fd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:53.636038 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-74286cec-4038-4e10-9ea6-e5a1842cc5fd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:53.650559 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-74286cec-4038-4e10-9ea6-e5a1842cc5fd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:53.651014 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-74286cec-4038-4e10-9ea6-e5a1842cc5fd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:53.653172 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-74286cec-4038-4e10-9ea6-e5a1842cc5fd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:53.653564 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-74286cec-4038-4e10-9ea6-e5a1842cc5fd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:53.756194 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-74286cec-4038-4e10-9ea6-e5a1842cc5fd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:53.763508 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-74286cec-4038-4e10-9ea6-e5a1842cc5fd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1296 microversion: 2.1 time: 0.135235 May 09 23:07:53.764093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 323/652] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:53 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1296 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:54.020949 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c6c205cb-5406-4989-b08e-ef64e1206904 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:54.021571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c6c205cb-5406-4989-b08e-ef64e1206904 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:54.030804 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c6c205cb-5406-4989-b08e-ef64e1206904 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:54.031259 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c6c205cb-5406-4989-b08e-ef64e1206904 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:54.032109 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c6c205cb-5406-4989-b08e-ef64e1206904 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:54.032488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c6c205cb-5406-4989-b08e-ef64e1206904 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:54.505662 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c6c205cb-5406-4989-b08e-ef64e1206904 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:54.513072 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c6c205cb-5406-4989-b08e-ef64e1206904 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 200 len: 1557 microversion: 2.1 time: 0.496013 May 09 23:07:54.513734 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 330/653] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:54 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 1557 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:54.529701 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-6557dca5-3957-4adb-86fb-b5a39304eba3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:54.530811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-6557dca5-3957-4adb-86fb-b5a39304eba3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:54.536822 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6557dca5-3957-4adb-86fb-b5a39304eba3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:54.537319 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6557dca5-3957-4adb-86fb-b5a39304eba3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:54.538194 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6557dca5-3957-4adb-86fb-b5a39304eba3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:54.538692 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6557dca5-3957-4adb-86fb-b5a39304eba3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:54.614986 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-6557dca5-3957-4adb-86fb-b5a39304eba3 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089091 May 09 23:07:54.615662 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 324/654] 10.222.0.23 () {58 vars in 1274 bytes} [Mon May 9 23:07:54 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:54.782522 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ad436589-97cf-489f-9f48-ce348f51054a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:54.784656 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ad436589-97cf-489f-9f48-ce348f51054a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:54.793723 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad436589-97cf-489f-9f48-ce348f51054a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:54.794339 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad436589-97cf-489f-9f48-ce348f51054a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:54.796268 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad436589-97cf-489f-9f48-ce348f51054a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:54.796951 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad436589-97cf-489f-9f48-ce348f51054a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:55.012612 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ad436589-97cf-489f-9f48-ce348f51054a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:55.023761 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ad436589-97cf-489f-9f48-ce348f51054a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1360 microversion: 2.1 time: 0.246282 May 09 23:07:55.025673 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 331/655] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:54 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1360 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:55.564313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-89dc63fa-b45c-4665-97c2-4286ac25df9f req-d51209fc-4554-41f2-a8ca-9720db3a9305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e8552f4-9cab-423d-ae4f-6790f5de0f91", "tag": "f0504a29-0f57-4b6a-b659-4d5559910b95"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:55.573132 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-89dc63fa-b45c-4665-97c2-4286ac25df9f req-d51209fc-4554-41f2-a8ca-9720db3a9305 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:55.573776 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-89dc63fa-b45c-4665-97c2-4286ac25df9f req-d51209fc-4554-41f2-a8ca-9720db3a9305 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:55.590780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-89dc63fa-b45c-4665-97c2-4286ac25df9f req-d51209fc-4554-41f2-a8ca-9720db3a9305 service nova] Creating event network-changed:f0504a29-0f57-4b6a-b659-4d5559910b95 for instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 on hv-cinder-84067 May 09 23:07:55.603533 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-89dc63fa-b45c-4665-97c2-4286ac25df9f req-d51209fc-4554-41f2-a8ca-9720db3a9305 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044693 May 09 23:07:55.604744 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 325/656] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:55.996210 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-9982c638-57d2-4247-9881-3f4eafc367d9 req-8896394f-a5ad-4a7f-a78a-0a286aa29fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "791da3e3-267a-4bdd-9761-386c1061811e", "tag": "79d9a4b3-de1a-4fc9-bd91-29fa1550dc38"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:07:56.005419 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-9982c638-57d2-4247-9881-3f4eafc367d9 req-8896394f-a5ad-4a7f-a78a-0a286aa29fb2 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:56.006138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-9982c638-57d2-4247-9881-3f4eafc367d9 req-8896394f-a5ad-4a7f-a78a-0a286aa29fb2 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:56.019733 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-9982c638-57d2-4247-9881-3f4eafc367d9 req-8896394f-a5ad-4a7f-a78a-0a286aa29fb2 service nova] Creating event network-changed:79d9a4b3-de1a-4fc9-bd91-29fa1550dc38 for instance 791da3e3-267a-4bdd-9761-386c1061811e on hv-cinder-84067 May 09 23:07:56.025669 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-9982c638-57d2-4247-9881-3f4eafc367d9 req-8896394f-a5ad-4a7f-a78a-0a286aa29fb2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108833 May 09 23:07:56.027332 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 332/657] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:07:56.042526 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cf6b0489-8695-4620-8d32-fad6ce930b9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:56.043340 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cf6b0489-8695-4620-8d32-fad6ce930b9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:56.050472 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf6b0489-8695-4620-8d32-fad6ce930b9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:56.051097 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf6b0489-8695-4620-8d32-fad6ce930b9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:56.051948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf6b0489-8695-4620-8d32-fad6ce930b9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:56.052480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf6b0489-8695-4620-8d32-fad6ce930b9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:56.183299 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cf6b0489-8695-4620-8d32-fad6ce930b9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:56.190643 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cf6b0489-8695-4620-8d32-fad6ce930b9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1360 microversion: 2.1 time: 0.152625 May 09 23:07:56.191228 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 326/658] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:56 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:57.208837 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-204f0bee-7b11-40bc-8cfc-8019aa90c40b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:57.209544 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-204f0bee-7b11-40bc-8cfc-8019aa90c40b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:57.215689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-204f0bee-7b11-40bc-8cfc-8019aa90c40b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:57.216142 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-204f0bee-7b11-40bc-8cfc-8019aa90c40b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:57.216907 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-204f0bee-7b11-40bc-8cfc-8019aa90c40b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:57.217471 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-204f0bee-7b11-40bc-8cfc-8019aa90c40b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:57.362643 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-204f0bee-7b11-40bc-8cfc-8019aa90c40b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:57.369816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-204f0bee-7b11-40bc-8cfc-8019aa90c40b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1360 microversion: 2.1 time: 0.165833 May 09 23:07:57.370413 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 333/659] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:57 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1360 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:58.386541 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a10e10fe-4dce-48e1-8f09-9b05e03e15f0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:58.387185 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a10e10fe-4dce-48e1-8f09-9b05e03e15f0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:58.393403 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a10e10fe-4dce-48e1-8f09-9b05e03e15f0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:58.393890 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a10e10fe-4dce-48e1-8f09-9b05e03e15f0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:58.394683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a10e10fe-4dce-48e1-8f09-9b05e03e15f0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:58.395119 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a10e10fe-4dce-48e1-8f09-9b05e03e15f0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:58.522045 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a10e10fe-4dce-48e1-8f09-9b05e03e15f0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:58.529262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a10e10fe-4dce-48e1-8f09-9b05e03e15f0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1360 microversion: 2.1 time: 0.146591 May 09 23:07:58.529837 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 327/660] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:58 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1360 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:07:59.539765 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-bec56468-05be-4bb4-94d8-063bc0f47eef tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:59.540291 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-bec56468-05be-4bb4-94d8-063bc0f47eef tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:59.546939 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-8b318df4-1c5f-429d-8de0-56b90f73d402 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:07:59.547408 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bec56468-05be-4bb4-94d8-063bc0f47eef tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:59.547662 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bec56468-05be-4bb4-94d8-063bc0f47eef tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:59.547958 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-8b318df4-1c5f-429d-8de0-56b90f73d402 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:07:59.548493 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bec56468-05be-4bb4-94d8-063bc0f47eef tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:59.548939 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bec56468-05be-4bb4-94d8-063bc0f47eef tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:59.554600 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8b318df4-1c5f-429d-8de0-56b90f73d402 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:59.555160 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8b318df4-1c5f-429d-8de0-56b90f73d402 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:59.556262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8b318df4-1c5f-429d-8de0-56b90f73d402 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:07:59.556745 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8b318df4-1c5f-429d-8de0-56b90f73d402 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:07:59.572803 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-bec56468-05be-4bb4-94d8-063bc0f47eef tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962/ips" status: 200 len: 153 microversion: 2.20 time: 0.036828 May 09 23:07:59.573566 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 334/661] 10.222.0.23 () {60 vars in 1288 bytes} [Mon May 9 23:07:59 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 23:07:59.704964 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-8b318df4-1c5f-429d-8de0-56b90f73d402 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:07:59.713583 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-8b318df4-1c5f-429d-8de0-56b90f73d402 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1360 microversion: 2.1 time: 0.170990 May 09 23:07:59.714451 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 328/662] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:07:59 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1360 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:08:00.732222 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-9755ebb4-d89f-471d-b6df-abd2121df03e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:00.732771 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-9755ebb4-d89f-471d-b6df-abd2121df03e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:00.739200 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9755ebb4-d89f-471d-b6df-abd2121df03e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:00.739653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9755ebb4-d89f-471d-b6df-abd2121df03e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:00.740418 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9755ebb4-d89f-471d-b6df-abd2121df03e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:00.740853 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9755ebb4-d89f-471d-b6df-abd2121df03e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:00.866638 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-9755ebb4-d89f-471d-b6df-abd2121df03e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:00.873928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-9755ebb4-d89f-471d-b6df-abd2121df03e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1360 microversion: 2.1 time: 0.145898 May 09 23:08:00.874712 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 335/663] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:08:00 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1360 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:08:01.320386 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-584d9528-4ee4-429f-942e-16d1ea1db648 req-01eb46bd-57d3-41dc-8ebd-d784c05c8538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e8552f4-9cab-423d-ae4f-6790f5de0f91", "name": "network-vif-plugged", "status": "completed", "tag": "f0504a29-0f57-4b6a-b659-4d5559910b95"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:08:01.328422 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-584d9528-4ee4-429f-942e-16d1ea1db648 req-01eb46bd-57d3-41dc-8ebd-d784c05c8538 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:01.328872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-584d9528-4ee4-429f-942e-16d1ea1db648 req-01eb46bd-57d3-41dc-8ebd-d784c05c8538 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:01.339745 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-584d9528-4ee4-429f-942e-16d1ea1db648 req-01eb46bd-57d3-41dc-8ebd-d784c05c8538 service nova] Creating event network-vif-plugged:f0504a29-0f57-4b6a-b659-4d5559910b95 for instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 on hv-cinder-84067 May 09 23:08:01.345029 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-584d9528-4ee4-429f-942e-16d1ea1db648 req-01eb46bd-57d3-41dc-8ebd-d784c05c8538 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082923 May 09 23:08:01.345689 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 329/664] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:08:01.600559 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ce143e06-b9a4-47df-94cf-3769c4b002fc tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:08:01.601094 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ce143e06-b9a4-47df-94cf-3769c4b002fc tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:01.607239 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ce143e06-b9a4-47df-94cf-3769c4b002fc tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:01.607687 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ce143e06-b9a4-47df-94cf-3769c4b002fc tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:01.608961 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ce143e06-b9a4-47df-94cf-3769c4b002fc tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:01.609393 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ce143e06-b9a4-47df-94cf-3769c4b002fc tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:01.631742 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.objects.instance [None req-ce143e06-b9a4-47df-94cf-3769c4b002fc tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lazy-loading 'flavor' on Instance uuid 0cdc1269-4f55-47ba-8ebc-a403362e1962 {{(pid=117143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:08:01.886622 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ce143e06-b9a4-47df-94cf-3769c4b002fc tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "POST /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962/action" status: 202 len: 0 microversion: 2.20 time: 0.289814 May 09 23:08:01.887391 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 336/665] 10.222.0.23 () {62 vars in 1318 bytes} [Mon May 9 23:08:01 2022] POST /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 23:08:01.893455 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cf35e4aa-0c60-49e0-9d22-308959deec9d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:01.894439 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cf35e4aa-0c60-49e0-9d22-308959deec9d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:01.896045 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-330cecb4-4628-418d-88b6-a76487badb63 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:01.896757 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-330cecb4-4628-418d-88b6-a76487badb63 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:01.901430 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf35e4aa-0c60-49e0-9d22-308959deec9d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:01.901969 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf35e4aa-0c60-49e0-9d22-308959deec9d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:01.903055 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf35e4aa-0c60-49e0-9d22-308959deec9d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:01.903353 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-330cecb4-4628-418d-88b6-a76487badb63 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:01.903582 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cf35e4aa-0c60-49e0-9d22-308959deec9d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:01.903814 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-330cecb4-4628-418d-88b6-a76487badb63 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:01.904614 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-330cecb4-4628-418d-88b6-a76487badb63 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:01.905616 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-330cecb4-4628-418d-88b6-a76487badb63 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:02.037760 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cf35e4aa-0c60-49e0-9d22-308959deec9d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:02.040271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-330cecb4-4628-418d-88b6-a76487badb63 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:02.045293 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cf35e4aa-0c60-49e0-9d22-308959deec9d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1360 microversion: 2.1 time: 0.159063 May 09 23:08:02.045944 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 330/666] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:08:01 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:08:02.048217 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-330cecb4-4628-418d-88b6-a76487badb63 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:02.049793 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-330cecb4-4628-418d-88b6-a76487badb63 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:02.051068 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-330cecb4-4628-418d-88b6-a76487badb63 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.159066 May 09 23:08:02.051697 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 337/667] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:01 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:08:03.062935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-384af7a2-e91d-4e07-89f8-f8ece119734b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:03.063786 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-384af7a2-e91d-4e07-89f8-f8ece119734b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:03.069760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d1cb383c-a80a-4dc4-a0f6-f6d9052f38e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:03.070473 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-384af7a2-e91d-4e07-89f8-f8ece119734b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:03.070938 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-384af7a2-e91d-4e07-89f8-f8ece119734b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:03.071897 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d1cb383c-a80a-4dc4-a0f6-f6d9052f38e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:03.072108 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-384af7a2-e91d-4e07-89f8-f8ece119734b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:03.072453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-384af7a2-e91d-4e07-89f8-f8ece119734b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:03.079288 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d1cb383c-a80a-4dc4-a0f6-f6d9052f38e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:03.079816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d1cb383c-a80a-4dc4-a0f6-f6d9052f38e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:03.080664 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d1cb383c-a80a-4dc4-a0f6-f6d9052f38e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:03.081210 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d1cb383c-a80a-4dc4-a0f6-f6d9052f38e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:03.203994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-384af7a2-e91d-4e07-89f8-f8ece119734b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:03.211403 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-384af7a2-e91d-4e07-89f8-f8ece119734b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1546 microversion: 2.1 time: 0.152417 May 09 23:08:03.212018 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 331/668] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:08:03 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:08:03.212246 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d1cb383c-a80a-4dc4-a0f6-f6d9052f38e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:03.220273 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d1cb383c-a80a-4dc4-a0f6-f6d9052f38e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:03.221762 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d1cb383c-a80a-4dc4-a0f6-f6d9052f38e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:03.222934 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d1cb383c-a80a-4dc4-a0f6-f6d9052f38e1 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.157898 May 09 23:08:03.223492 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 338/669] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:03 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:03.227474 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-afda2e8d-44b0-4709-ae7f-5e8dd058838a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:03.227972 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-afda2e8d-44b0-4709-ae7f-5e8dd058838a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:03.234453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-afda2e8d-44b0-4709-ae7f-5e8dd058838a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:03.234938 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-afda2e8d-44b0-4709-ae7f-5e8dd058838a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:03.235703 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-afda2e8d-44b0-4709-ae7f-5e8dd058838a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:03.236139 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-afda2e8d-44b0-4709-ae7f-5e8dd058838a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:03.309919 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-afda2e8d-44b0-4709-ae7f-5e8dd058838a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086080 May 09 23:08:03.310572 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 332/670] 10.222.0.23 () {58 vars in 1274 bytes} [Mon May 9 23:08:03 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/os-interface => generated 284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:08:04.242455 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-81e41dc7-c3bc-4d97-ba3e-57bd1ee393f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:04.243068 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-81e41dc7-c3bc-4d97-ba3e-57bd1ee393f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:04.249533 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-81e41dc7-c3bc-4d97-ba3e-57bd1ee393f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:04.249990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-81e41dc7-c3bc-4d97-ba3e-57bd1ee393f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:04.250797 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-81e41dc7-c3bc-4d97-ba3e-57bd1ee393f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:04.253906 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-81e41dc7-c3bc-4d97-ba3e-57bd1ee393f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:04.262319 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-e7eced76-21fe-4adc-9313-ded18a0d74c0 req-b353c529-ce5e-4722-9574-7600f5b05755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e8552f4-9cab-423d-ae4f-6790f5de0f91", "tag": "f0504a29-0f57-4b6a-b659-4d5559910b95"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:08:04.271216 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-e7eced76-21fe-4adc-9313-ded18a0d74c0 req-b353c529-ce5e-4722-9574-7600f5b05755 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:04.271748 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-e7eced76-21fe-4adc-9313-ded18a0d74c0 req-b353c529-ce5e-4722-9574-7600f5b05755 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:04.283405 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-e7eced76-21fe-4adc-9313-ded18a0d74c0 req-b353c529-ce5e-4722-9574-7600f5b05755 service nova] Creating event network-changed:f0504a29-0f57-4b6a-b659-4d5559910b95 for instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 on hv-cinder-84067 May 09 23:08:04.288246 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-e7eced76-21fe-4adc-9313-ded18a0d74c0 req-b353c529-ce5e-4722-9574-7600f5b05755 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029578 May 09 23:08:04.289201 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 333/671] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:08:04.465839 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-81e41dc7-c3bc-4d97-ba3e-57bd1ee393f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:04.473747 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-81e41dc7-c3bc-4d97-ba3e-57bd1ee393f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:04.475381 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-81e41dc7-c3bc-4d97-ba3e-57bd1ee393f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:04.476521 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-81e41dc7-c3bc-4d97-ba3e-57bd1ee393f5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.238212 May 09 23:08:04.477306 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 339/672] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:04 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:05.495849 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5e06c4b1-9897-4e0c-aa74-51b6f393c9e3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:05.496550 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5e06c4b1-9897-4e0c-aa74-51b6f393c9e3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:05.502846 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5e06c4b1-9897-4e0c-aa74-51b6f393c9e3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:05.503298 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5e06c4b1-9897-4e0c-aa74-51b6f393c9e3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:05.504062 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5e06c4b1-9897-4e0c-aa74-51b6f393c9e3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:05.504495 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5e06c4b1-9897-4e0c-aa74-51b6f393c9e3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:05.634969 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5e06c4b1-9897-4e0c-aa74-51b6f393c9e3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:05.643297 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5e06c4b1-9897-4e0c-aa74-51b6f393c9e3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:05.644807 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5e06c4b1-9897-4e0c-aa74-51b6f393c9e3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:05.645979 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5e06c4b1-9897-4e0c-aa74-51b6f393c9e3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.154811 May 09 23:08:05.646588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 334/673] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:05 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:06.664670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2d6a4c43-6bf6-4e9b-8fdb-6ee7d2e7be46 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:06.665277 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2d6a4c43-6bf6-4e9b-8fdb-6ee7d2e7be46 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:06.671944 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2d6a4c43-6bf6-4e9b-8fdb-6ee7d2e7be46 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:06.672398 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2d6a4c43-6bf6-4e9b-8fdb-6ee7d2e7be46 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:06.673161 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2d6a4c43-6bf6-4e9b-8fdb-6ee7d2e7be46 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:06.673590 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2d6a4c43-6bf6-4e9b-8fdb-6ee7d2e7be46 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:06.802567 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2d6a4c43-6bf6-4e9b-8fdb-6ee7d2e7be46 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:06.810133 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2d6a4c43-6bf6-4e9b-8fdb-6ee7d2e7be46 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:06.811774 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2d6a4c43-6bf6-4e9b-8fdb-6ee7d2e7be46 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:06.812921 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2d6a4c43-6bf6-4e9b-8fdb-6ee7d2e7be46 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.152164 May 09 23:08:06.813483 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 340/674] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:06 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:07.831311 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-01970d43-692f-4945-b626-2ddadf0a04d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:07.831922 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-01970d43-692f-4945-b626-2ddadf0a04d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:07.838391 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-01970d43-692f-4945-b626-2ddadf0a04d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:07.838842 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-01970d43-692f-4945-b626-2ddadf0a04d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:07.839607 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-01970d43-692f-4945-b626-2ddadf0a04d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:07.840040 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-01970d43-692f-4945-b626-2ddadf0a04d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:07.966685 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-01970d43-692f-4945-b626-2ddadf0a04d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:07.974269 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-01970d43-692f-4945-b626-2ddadf0a04d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:07.975766 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-01970d43-692f-4945-b626-2ddadf0a04d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:07.976918 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-01970d43-692f-4945-b626-2ddadf0a04d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.149505 May 09 23:08:07.977478 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 335/675] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:07 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:08.999475 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-3872a2e6-0073-47bc-816f-e49b92917b7c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:09.000025 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-3872a2e6-0073-47bc-816f-e49b92917b7c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:09.008514 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3872a2e6-0073-47bc-816f-e49b92917b7c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:09.009249 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3872a2e6-0073-47bc-816f-e49b92917b7c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:09.009801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3872a2e6-0073-47bc-816f-e49b92917b7c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:09.010267 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3872a2e6-0073-47bc-816f-e49b92917b7c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:09.135692 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3872a2e6-0073-47bc-816f-e49b92917b7c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:09.143491 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3872a2e6-0073-47bc-816f-e49b92917b7c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:09.144994 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3872a2e6-0073-47bc-816f-e49b92917b7c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:09.146172 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-3872a2e6-0073-47bc-816f-e49b92917b7c tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.151816 May 09 23:08:09.146748 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 341/676] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:08 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:10.163649 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c497cfe7-d797-4192-9adb-ddadd77eeab5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:10.164250 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c497cfe7-d797-4192-9adb-ddadd77eeab5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:10.170632 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c497cfe7-d797-4192-9adb-ddadd77eeab5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:10.171202 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c497cfe7-d797-4192-9adb-ddadd77eeab5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:10.172483 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c497cfe7-d797-4192-9adb-ddadd77eeab5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:10.172921 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c497cfe7-d797-4192-9adb-ddadd77eeab5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:10.297606 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c497cfe7-d797-4192-9adb-ddadd77eeab5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:10.305302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c497cfe7-d797-4192-9adb-ddadd77eeab5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:10.306861 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c497cfe7-d797-4192-9adb-ddadd77eeab5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:10.308023 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c497cfe7-d797-4192-9adb-ddadd77eeab5 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.148329 May 09 23:08:10.308597 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 336/677] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:10 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:11.326282 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-8a496995-b691-4233-a4e2-752b5ec60d13 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:11.326897 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-8a496995-b691-4233-a4e2-752b5ec60d13 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:11.333203 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8a496995-b691-4233-a4e2-752b5ec60d13 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:11.333654 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8a496995-b691-4233-a4e2-752b5ec60d13 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:11.334484 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8a496995-b691-4233-a4e2-752b5ec60d13 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:11.334920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8a496995-b691-4233-a4e2-752b5ec60d13 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:11.467490 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-8a496995-b691-4233-a4e2-752b5ec60d13 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:11.475203 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-8a496995-b691-4233-a4e2-752b5ec60d13 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:11.476704 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-8a496995-b691-4233-a4e2-752b5ec60d13 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:11.477866 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-8a496995-b691-4233-a4e2-752b5ec60d13 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.155485 May 09 23:08:11.478467 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 342/678] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:11 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:12.496594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-faa5778f-0810-474f-a0aa-03afb48b790d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:12.497219 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-faa5778f-0810-474f-a0aa-03afb48b790d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:12.503995 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-faa5778f-0810-474f-a0aa-03afb48b790d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:12.504439 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-faa5778f-0810-474f-a0aa-03afb48b790d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:12.505197 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-faa5778f-0810-474f-a0aa-03afb48b790d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:12.505623 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-faa5778f-0810-474f-a0aa-03afb48b790d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:12.634023 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-faa5778f-0810-474f-a0aa-03afb48b790d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:12.642635 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-faa5778f-0810-474f-a0aa-03afb48b790d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:12.644156 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-faa5778f-0810-474f-a0aa-03afb48b790d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:12.645321 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-faa5778f-0810-474f-a0aa-03afb48b790d tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.152642 May 09 23:08:12.645898 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 337/679] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:12 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:13.664055 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1a67e27c-c5d6-48c4-b47e-772a4c49a38f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:13.664792 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1a67e27c-c5d6-48c4-b47e-772a4c49a38f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:13.672469 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1a67e27c-c5d6-48c4-b47e-772a4c49a38f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:13.672856 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1a67e27c-c5d6-48c4-b47e-772a4c49a38f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:13.674201 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1a67e27c-c5d6-48c4-b47e-772a4c49a38f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:13.674460 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1a67e27c-c5d6-48c4-b47e-772a4c49a38f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:13.806462 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1a67e27c-c5d6-48c4-b47e-772a4c49a38f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:13.814362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1a67e27c-c5d6-48c4-b47e-772a4c49a38f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:13.815864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-1a67e27c-c5d6-48c4-b47e-772a4c49a38f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:13.816994 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1a67e27c-c5d6-48c4-b47e-772a4c49a38f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.157574 May 09 23:08:13.817551 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 343/680] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:13 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:14.835485 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-72c0a3cd-f02b-4411-b5ce-c87918670856 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:14.836269 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-72c0a3cd-f02b-4411-b5ce-c87918670856 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:14.842290 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-72c0a3cd-f02b-4411-b5ce-c87918670856 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:14.843241 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-72c0a3cd-f02b-4411-b5ce-c87918670856 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:14.844004 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-72c0a3cd-f02b-4411-b5ce-c87918670856 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:14.844436 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-72c0a3cd-f02b-4411-b5ce-c87918670856 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:14.975608 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-72c0a3cd-f02b-4411-b5ce-c87918670856 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:14.984064 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-72c0a3cd-f02b-4411-b5ce-c87918670856 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:14.985557 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-72c0a3cd-f02b-4411-b5ce-c87918670856 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:14.986727 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-72c0a3cd-f02b-4411-b5ce-c87918670856 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.155261 May 09 23:08:14.987283 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 338/681] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:14 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:16.004426 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2e8cc235-fdd0-4305-a86f-a50eefad19f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:16.004962 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2e8cc235-fdd0-4305-a86f-a50eefad19f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:16.011596 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2e8cc235-fdd0-4305-a86f-a50eefad19f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:16.012052 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2e8cc235-fdd0-4305-a86f-a50eefad19f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:16.012822 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2e8cc235-fdd0-4305-a86f-a50eefad19f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:16.013261 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2e8cc235-fdd0-4305-a86f-a50eefad19f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:16.141731 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2e8cc235-fdd0-4305-a86f-a50eefad19f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:16.149505 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2e8cc235-fdd0-4305-a86f-a50eefad19f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:16.151032 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2e8cc235-fdd0-4305-a86f-a50eefad19f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:16.152183 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2e8cc235-fdd0-4305-a86f-a50eefad19f3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.151835 May 09 23:08:16.152755 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 344/682] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:15 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:17.170008 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-4724220e-cb81-47fe-8f82-00ebe6d44fc6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:17.170662 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-4724220e-cb81-47fe-8f82-00ebe6d44fc6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:17.177538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4724220e-cb81-47fe-8f82-00ebe6d44fc6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:17.177991 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4724220e-cb81-47fe-8f82-00ebe6d44fc6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:17.178792 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4724220e-cb81-47fe-8f82-00ebe6d44fc6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:17.179230 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4724220e-cb81-47fe-8f82-00ebe6d44fc6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:17.303818 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-4724220e-cb81-47fe-8f82-00ebe6d44fc6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:17.311473 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-4724220e-cb81-47fe-8f82-00ebe6d44fc6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:17.312984 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-4724220e-cb81-47fe-8f82-00ebe6d44fc6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:17.314163 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-4724220e-cb81-47fe-8f82-00ebe6d44fc6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.148021 May 09 23:08:17.314867 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 339/683] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:17 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:18.332750 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6a368790-c0ca-4318-9269-c3cf5a26e7a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:18.333355 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6a368790-c0ca-4318-9269-c3cf5a26e7a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:18.339341 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6a368790-c0ca-4318-9269-c3cf5a26e7a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:18.339792 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6a368790-c0ca-4318-9269-c3cf5a26e7a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:18.340635 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6a368790-c0ca-4318-9269-c3cf5a26e7a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:18.341172 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6a368790-c0ca-4318-9269-c3cf5a26e7a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:18.468890 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6a368790-c0ca-4318-9269-c3cf5a26e7a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:18.476579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6a368790-c0ca-4318-9269-c3cf5a26e7a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:18.478097 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6a368790-c0ca-4318-9269-c3cf5a26e7a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:18.479263 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6a368790-c0ca-4318-9269-c3cf5a26e7a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1744 microversion: 2.20 time: 0.150401 May 09 23:08:18.479812 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 345/684] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:18 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:19.496777 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fca22585-6768-4664-b2d1-dc5df3f10666 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:19.497379 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-fca22585-6768-4664-b2d1-dc5df3f10666 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:19.504209 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fca22585-6768-4664-b2d1-dc5df3f10666 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:19.504696 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fca22585-6768-4664-b2d1-dc5df3f10666 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:19.505505 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fca22585-6768-4664-b2d1-dc5df3f10666 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:19.506634 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fca22585-6768-4664-b2d1-dc5df3f10666 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:19.638385 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-fca22585-6768-4664-b2d1-dc5df3f10666 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:19.646656 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-fca22585-6768-4664-b2d1-dc5df3f10666 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:19.648076 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-fca22585-6768-4664-b2d1-dc5df3f10666 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:19.649222 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-fca22585-6768-4664-b2d1-dc5df3f10666 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1744 microversion: 2.20 time: 0.156425 May 09 23:08:19.649780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 340/685] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:19 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:20.667760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-4407977f-f270-4671-8f47-ee15f9af2cba tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:20.668359 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-4407977f-f270-4671-8f47-ee15f9af2cba tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:20.675269 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4407977f-f270-4671-8f47-ee15f9af2cba tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:20.675719 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4407977f-f270-4671-8f47-ee15f9af2cba tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:20.676492 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4407977f-f270-4671-8f47-ee15f9af2cba tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:20.676930 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4407977f-f270-4671-8f47-ee15f9af2cba tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:20.813760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4407977f-f270-4671-8f47-ee15f9af2cba tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:20.821451 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4407977f-f270-4671-8f47-ee15f9af2cba tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:20.822977 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4407977f-f270-4671-8f47-ee15f9af2cba tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:20.824230 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-4407977f-f270-4671-8f47-ee15f9af2cba tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1739 microversion: 2.20 time: 0.160244 May 09 23:08:20.824771 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 346/686] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:20 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:21.845881 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f31c27bc-f854-40ba-a8fe-1670507c6190 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:21.846689 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f31c27bc-f854-40ba-a8fe-1670507c6190 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:21.853056 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f31c27bc-f854-40ba-a8fe-1670507c6190 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:21.853765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f31c27bc-f854-40ba-a8fe-1670507c6190 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:21.855372 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f31c27bc-f854-40ba-a8fe-1670507c6190 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:21.856476 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f31c27bc-f854-40ba-a8fe-1670507c6190 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:22.003119 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f31c27bc-f854-40ba-a8fe-1670507c6190 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:22.011619 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f31c27bc-f854-40ba-a8fe-1670507c6190 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:22.013242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f31c27bc-f854-40ba-a8fe-1670507c6190 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:22.015488 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f31c27bc-f854-40ba-a8fe-1670507c6190 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1739 microversion: 2.20 time: 0.176014 May 09 23:08:22.026146 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 341/687] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:21 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:23.036259 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b8bbcf2d-fcad-4c98-8bbc-b14638fca6dd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:23.036878 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b8bbcf2d-fcad-4c98-8bbc-b14638fca6dd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:23.043620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b8bbcf2d-fcad-4c98-8bbc-b14638fca6dd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:23.044646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b8bbcf2d-fcad-4c98-8bbc-b14638fca6dd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:23.045730 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b8bbcf2d-fcad-4c98-8bbc-b14638fca6dd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:23.046566 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b8bbcf2d-fcad-4c98-8bbc-b14638fca6dd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:23.195024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b8bbcf2d-fcad-4c98-8bbc-b14638fca6dd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:23.203861 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b8bbcf2d-fcad-4c98-8bbc-b14638fca6dd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:23.205516 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b8bbcf2d-fcad-4c98-8bbc-b14638fca6dd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:23.208620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b8bbcf2d-fcad-4c98-8bbc-b14638fca6dd tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1739 microversion: 2.20 time: 0.175131 May 09 23:08:23.209293 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 347/688] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:23 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:23.445338 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-669ae753-6007-454b-9792-74533aa90610 req-0e87762d-ad74-4b42-9f80-3bc36b135761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cdc1269-4f55-47ba-8ebc-a403362e1962", "name": "network-vif-plugged", "status": "completed", "tag": "a898f67f-017d-433f-9c0f-e6793182e363"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:08:23.454961 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-669ae753-6007-454b-9792-74533aa90610 req-0e87762d-ad74-4b42-9f80-3bc36b135761 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:23.455775 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-669ae753-6007-454b-9792-74533aa90610 req-0e87762d-ad74-4b42-9f80-3bc36b135761 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:23.468327 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-669ae753-6007-454b-9792-74533aa90610 req-0e87762d-ad74-4b42-9f80-3bc36b135761 service nova] Creating event network-vif-plugged:a898f67f-017d-433f-9c0f-e6793182e363 for instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 on hv-cinder-84067 May 09 23:08:23.473570 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-669ae753-6007-454b-9792-74533aa90610 req-0e87762d-ad74-4b42-9f80-3bc36b135761 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032366 May 09 23:08:23.474259 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 342/689] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:08:24.226817 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-56913b45-d9a2-4e82-9a3d-78e60d8be44a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:24.227436 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-56913b45-d9a2-4e82-9a3d-78e60d8be44a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:24.235049 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-56913b45-d9a2-4e82-9a3d-78e60d8be44a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:24.235498 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-56913b45-d9a2-4e82-9a3d-78e60d8be44a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:24.236347 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-56913b45-d9a2-4e82-9a3d-78e60d8be44a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:24.237019 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-56913b45-d9a2-4e82-9a3d-78e60d8be44a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:24.396353 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-56913b45-d9a2-4e82-9a3d-78e60d8be44a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:24.407708 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-56913b45-d9a2-4e82-9a3d-78e60d8be44a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:24.410412 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-56913b45-d9a2-4e82-9a3d-78e60d8be44a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:24.411620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-56913b45-d9a2-4e82-9a3d-78e60d8be44a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1739 microversion: 2.20 time: 0.188773 May 09 23:08:24.418212 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 348/690] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:24 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:25.431768 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-3c827055-e99f-40bd-a3b5-4954ef877451 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:25.432397 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-3c827055-e99f-40bd-a3b5-4954ef877451 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:25.439533 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3c827055-e99f-40bd-a3b5-4954ef877451 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:25.440506 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3c827055-e99f-40bd-a3b5-4954ef877451 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:25.441300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3c827055-e99f-40bd-a3b5-4954ef877451 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:25.441741 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-3c827055-e99f-40bd-a3b5-4954ef877451 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:25.598287 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-3c827055-e99f-40bd-a3b5-4954ef877451 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:25.607116 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-3c827055-e99f-40bd-a3b5-4954ef877451 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:25.609122 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-3c827055-e99f-40bd-a3b5-4954ef877451 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:25.610376 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-3c827055-e99f-40bd-a3b5-4954ef877451 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1739 microversion: 2.20 time: 0.183606 May 09 23:08:25.613514 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 343/691] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:25 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:26.630747 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-30e995a4-8e74-4d1f-be16-af3157ea3a17 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:26.631491 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-30e995a4-8e74-4d1f-be16-af3157ea3a17 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:26.638836 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-30e995a4-8e74-4d1f-be16-af3157ea3a17 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:26.640024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-30e995a4-8e74-4d1f-be16-af3157ea3a17 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:26.640919 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-30e995a4-8e74-4d1f-be16-af3157ea3a17 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:26.641479 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-30e995a4-8e74-4d1f-be16-af3157ea3a17 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:26.790720 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-30e995a4-8e74-4d1f-be16-af3157ea3a17 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:26.799584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-30e995a4-8e74-4d1f-be16-af3157ea3a17 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:26.801280 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-30e995a4-8e74-4d1f-be16-af3157ea3a17 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:26.802651 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-30e995a4-8e74-4d1f-be16-af3157ea3a17 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1739 microversion: 2.20 time: 0.178886 May 09 23:08:26.813996 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 349/692] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:26 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:27.821284 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-66d9742c-48ab-490d-857e-0bab4f770f18 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:27.822181 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-66d9742c-48ab-490d-857e-0bab4f770f18 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:27.828468 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-66d9742c-48ab-490d-857e-0bab4f770f18 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:27.828922 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-66d9742c-48ab-490d-857e-0bab4f770f18 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:27.829908 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-66d9742c-48ab-490d-857e-0bab4f770f18 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:27.830381 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-66d9742c-48ab-490d-857e-0bab4f770f18 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:27.976547 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-66d9742c-48ab-490d-857e-0bab4f770f18 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:27.985591 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-66d9742c-48ab-490d-857e-0bab4f770f18 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:27.988098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-66d9742c-48ab-490d-857e-0bab4f770f18 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:27.988500 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-66d9742c-48ab-490d-857e-0bab4f770f18 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1739 microversion: 2.20 time: 0.171630 May 09 23:08:28.000674 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 344/693] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:27 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:29.010036 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c75102e9-113a-4acb-b496-06fc3e9c3704 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:29.011391 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c75102e9-113a-4acb-b496-06fc3e9c3704 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:29.018068 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c75102e9-113a-4acb-b496-06fc3e9c3704 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:29.018558 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c75102e9-113a-4acb-b496-06fc3e9c3704 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:29.019424 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c75102e9-113a-4acb-b496-06fc3e9c3704 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:29.020240 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c75102e9-113a-4acb-b496-06fc3e9c3704 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:29.164090 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c75102e9-113a-4acb-b496-06fc3e9c3704 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:29.173237 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c75102e9-113a-4acb-b496-06fc3e9c3704 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:29.174806 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c75102e9-113a-4acb-b496-06fc3e9c3704 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:29.175968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c75102e9-113a-4acb-b496-06fc3e9c3704 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1739 microversion: 2.20 time: 0.171593 May 09 23:08:29.176552 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 350/694] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:29 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:30.193312 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d3c2ec46-0100-48c9-8fd0-83baa4d844a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:30.193987 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-d3c2ec46-0100-48c9-8fd0-83baa4d844a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:30.200512 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d3c2ec46-0100-48c9-8fd0-83baa4d844a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:30.200966 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d3c2ec46-0100-48c9-8fd0-83baa4d844a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:30.201736 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d3c2ec46-0100-48c9-8fd0-83baa4d844a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:30.202192 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d3c2ec46-0100-48c9-8fd0-83baa4d844a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:30.326607 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-d3c2ec46-0100-48c9-8fd0-83baa4d844a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:30.334371 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-d3c2ec46-0100-48c9-8fd0-83baa4d844a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:30.335869 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-d3c2ec46-0100-48c9-8fd0-83baa4d844a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:30.337074 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d3c2ec46-0100-48c9-8fd0-83baa4d844a6 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1721 microversion: 2.20 time: 0.147660 May 09 23:08:30.337667 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 345/695] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:30 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:31.355149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a09aa8dd-517e-4f8a-847f-83c5074d4020 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:31.355769 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a09aa8dd-517e-4f8a-847f-83c5074d4020 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:31.362908 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a09aa8dd-517e-4f8a-847f-83c5074d4020 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:31.363363 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a09aa8dd-517e-4f8a-847f-83c5074d4020 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:31.364135 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a09aa8dd-517e-4f8a-847f-83c5074d4020 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:31.364573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a09aa8dd-517e-4f8a-847f-83c5074d4020 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:31.492350 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a09aa8dd-517e-4f8a-847f-83c5074d4020 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:31.500058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a09aa8dd-517e-4f8a-847f-83c5074d4020 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:31.501546 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a09aa8dd-517e-4f8a-847f-83c5074d4020 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:31.502807 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a09aa8dd-517e-4f8a-847f-83c5074d4020 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1721 microversion: 2.20 time: 0.151546 May 09 23:08:31.503380 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 351/696] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:31 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:08:32.521648 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f50d3a17-2428-44a6-aef9-3dea1e31b8c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:32.522238 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f50d3a17-2428-44a6-aef9-3dea1e31b8c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:32.528476 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f50d3a17-2428-44a6-aef9-3dea1e31b8c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:32.528909 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f50d3a17-2428-44a6-aef9-3dea1e31b8c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:32.529675 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f50d3a17-2428-44a6-aef9-3dea1e31b8c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:32.530105 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f50d3a17-2428-44a6-aef9-3dea1e31b8c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:32.668807 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f50d3a17-2428-44a6-aef9-3dea1e31b8c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:32.676512 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f50d3a17-2428-44a6-aef9-3dea1e31b8c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:32.678012 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f50d3a17-2428-44a6-aef9-3dea1e31b8c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:32.679181 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f50d3a17-2428-44a6-aef9-3dea1e31b8c3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1724 microversion: 2.20 time: 0.161532 May 09 23:08:32.679740 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 346/697] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:32 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:32.696992 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-31d81e26-bb06-41dd-ac95-84a972e8a35e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64061f3b-58a4-4af2-b4f5-4aead8255d98"}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:08:32.698137 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-31d81e26-bb06-41dd-ac95-84a972e8a35e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:32.704909 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31d81e26-bb06-41dd-ac95-84a972e8a35e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:32.705356 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31d81e26-bb06-41dd-ac95-84a972e8a35e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:32.706141 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31d81e26-bb06-41dd-ac95-84a972e8a35e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:32.706581 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31d81e26-bb06-41dd-ac95-84a972e8a35e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:32.950739 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-31d81e26-bb06-41dd-ac95-84a972e8a35e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "POST /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.257628 May 09 23:08:32.951340 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 352/698] 10.222.0.23 () {62 vars in 1363 bytes} [Mon May 9 23:08:32 2022] POST /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962/os-volume_attachments => generated 188 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 23:08:33.059327 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a4b47679-8f66-49c4-aba4-8aee15f4db01 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:33.059823 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a4b47679-8f66-49c4-aba4-8aee15f4db01 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:33.066255 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a4b47679-8f66-49c4-aba4-8aee15f4db01 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:33.066703 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a4b47679-8f66-49c4-aba4-8aee15f4db01 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:33.067464 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a4b47679-8f66-49c4-aba4-8aee15f4db01 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:33.067900 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a4b47679-8f66-49c4-aba4-8aee15f4db01 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:33.291087 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a4b47679-8f66-49c4-aba4-8aee15f4db01 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962/os-volume_attachments/64061f3b-58a4-4af2-b4f5-4aead8255d98" status: 202 len: 0 microversion: 2.20 time: 0.235612 May 09 23:08:33.291716 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 347/699] 10.222.0.23 () {60 vars in 1456 bytes} [Mon May 9 23:08:33 2022] DELETE /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962/os-volume_attachments/64061f3b-58a4-4af2-b4f5-4aead8255d98 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 23:08:33.347186 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-967f8967-4715-4a5d-9278-9fa01eff6484 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:08:33.347777 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-967f8967-4715-4a5d-9278-9fa01eff6484 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:33.353502 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-967f8967-4715-4a5d-9278-9fa01eff6484 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:33.353948 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-967f8967-4715-4a5d-9278-9fa01eff6484 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:33.354752 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-967f8967-4715-4a5d-9278-9fa01eff6484 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:33.355183 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-967f8967-4715-4a5d-9278-9fa01eff6484 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:33.439847 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-f3a6e007-ecf1-46dc-abc0-47b4b1eaf642 req-2b1ee6bd-9975-4353-89c2-da61a78b0bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cdc1269-4f55-47ba-8ebc-a403362e1962", "name": "network-vif-unplugged", "status": "completed", "tag": "a898f67f-017d-433f-9c0f-e6793182e363"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:08:33.450388 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-967f8967-4715-4a5d-9278-9fa01eff6484 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "POST /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962/action" status: 202 len: 0 microversion: 2.20 time: 0.107699 May 09 23:08:33.451004 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 353/700] 10.222.0.23 () {62 vars in 1318 bytes} [Mon May 9 23:08:33 2022] POST /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 23:08:33.453868 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-f3a6e007-ecf1-46dc-abc0-47b4b1eaf642 req-2b1ee6bd-9975-4353-89c2-da61a78b0bef service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:33.454743 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-f3a6e007-ecf1-46dc-abc0-47b4b1eaf642 req-2b1ee6bd-9975-4353-89c2-da61a78b0bef service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:33.460853 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ef597b29-f207-48c0-a597-f1ca7017148e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:33.461495 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ef597b29-f207-48c0-a597-f1ca7017148e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:33.466473 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.compute.server_external_events [req-f3a6e007-ecf1-46dc-abc0-47b4b1eaf642 req-2b1ee6bd-9975-4353-89c2-da61a78b0bef service nova] Unable to find a host for instance 0cdc1269-4f55-47ba-8ebc-a403362e1962. Dropping event network-vif-unplugged {{(pid=117142) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 09 23:08:33.467375 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-f3a6e007-ecf1-46dc-abc0-47b4b1eaf642 req-2b1ee6bd-9975-4353-89c2-da61a78b0bef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033163 May 09 23:08:33.468316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ef597b29-f207-48c0-a597-f1ca7017148e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:33.468473 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 348/701] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 09 23:08:33.468768 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ef597b29-f207-48c0-a597-f1ca7017148e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:33.469885 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ef597b29-f207-48c0-a597-f1ca7017148e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:33.470342 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ef597b29-f207-48c0-a597-f1ca7017148e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:33.643166 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ef597b29-f207-48c0-a597-f1ca7017148e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:33.651272 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ef597b29-f207-48c0-a597-f1ca7017148e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:33.652777 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ef597b29-f207-48c0-a597-f1ca7017148e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:33.653939 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ef597b29-f207-48c0-a597-f1ca7017148e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1672 microversion: 2.20 time: 0.197978 May 09 23:08:33.654559 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 354/702] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:33 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1672 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:08:33.947635 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-bda65e34-f493-4f9f-b789-f77780187f50 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:33.948197 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-bda65e34-f493-4f9f-b789-f77780187f50 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:33.954358 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bda65e34-f493-4f9f-b789-f77780187f50 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:33.954806 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bda65e34-f493-4f9f-b789-f77780187f50 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:33.955573 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bda65e34-f493-4f9f-b789-f77780187f50 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:33.956011 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bda65e34-f493-4f9f-b789-f77780187f50 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:33.978307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-bda65e34-f493-4f9f-b789-f77780187f50 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/ips" status: 200 len: 149 microversion: 2.1 time: 0.034433 May 09 23:08:33.978893 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 349/703] 10.222.0.23 () {58 vars in 1247 bytes} [Mon May 9 23:08:33 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:08:34.673848 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b1aba0fe-d926-4161-a536-038c2e7158f4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:34.674514 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b1aba0fe-d926-4161-a536-038c2e7158f4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:34.680452 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b1aba0fe-d926-4161-a536-038c2e7158f4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:34.680903 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b1aba0fe-d926-4161-a536-038c2e7158f4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:34.681695 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b1aba0fe-d926-4161-a536-038c2e7158f4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:34.682156 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b1aba0fe-d926-4161-a536-038c2e7158f4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:34.882787 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b1aba0fe-d926-4161-a536-038c2e7158f4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:34.890911 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b1aba0fe-d926-4161-a536-038c2e7158f4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:34.892416 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b1aba0fe-d926-4161-a536-038c2e7158f4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:34.893579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b1aba0fe-d926-4161-a536-038c2e7158f4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.224712 May 09 23:08:34.894377 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 355/704] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:34 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:35.291734 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-eb3aa710-47ff-4b95-8e6d-82e913506bc0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb02b9b2-d5a5-496e-b9f1-b981af78ce17"}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:08:35.292786 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-eb3aa710-47ff-4b95-8e6d-82e913506bc0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:35.299101 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eb3aa710-47ff-4b95-8e6d-82e913506bc0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:35.299553 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eb3aa710-47ff-4b95-8e6d-82e913506bc0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:35.300327 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eb3aa710-47ff-4b95-8e6d-82e913506bc0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:35.300762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-eb3aa710-47ff-4b95-8e6d-82e913506bc0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:35.912866 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-4e1864c7-2f9a-44ab-bba1-faf83c0cbfa7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:35.913416 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-4e1864c7-2f9a-44ab-bba1-faf83c0cbfa7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:35.919759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4e1864c7-2f9a-44ab-bba1-faf83c0cbfa7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:35.920197 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4e1864c7-2f9a-44ab-bba1-faf83c0cbfa7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:35.920954 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4e1864c7-2f9a-44ab-bba1-faf83c0cbfa7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:35.921380 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4e1864c7-2f9a-44ab-bba1-faf83c0cbfa7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:36.055794 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4e1864c7-2f9a-44ab-bba1-faf83c0cbfa7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:36.064156 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4e1864c7-2f9a-44ab-bba1-faf83c0cbfa7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:36.065655 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4e1864c7-2f9a-44ab-bba1-faf83c0cbfa7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:36.067079 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-4e1864c7-2f9a-44ab-bba1-faf83c0cbfa7 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.158188 May 09 23:08:36.067653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 356/705] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:35 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:08:37.085840 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f54d89c6-c233-45da-b158-dcc04736cc5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:37.087300 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f54d89c6-c233-45da-b158-dcc04736cc5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:37.095020 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f54d89c6-c233-45da-b158-dcc04736cc5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:37.095944 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f54d89c6-c233-45da-b158-dcc04736cc5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:37.096942 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f54d89c6-c233-45da-b158-dcc04736cc5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:37.097590 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f54d89c6-c233-45da-b158-dcc04736cc5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:37.234823 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f54d89c6-c233-45da-b158-dcc04736cc5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:37.243337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f54d89c6-c233-45da-b158-dcc04736cc5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:37.244829 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f54d89c6-c233-45da-b158-dcc04736cc5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:37.245981 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f54d89c6-c233-45da-b158-dcc04736cc5a tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.164155 May 09 23:08:37.246592 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 357/706] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:37 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:08:38.267523 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e1f33276-2009-49eb-8eb4-bd00d3b5133e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:38.273494 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e1f33276-2009-49eb-8eb4-bd00d3b5133e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:38.284838 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e1f33276-2009-49eb-8eb4-bd00d3b5133e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:38.285147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e1f33276-2009-49eb-8eb4-bd00d3b5133e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:38.286266 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e1f33276-2009-49eb-8eb4-bd00d3b5133e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:38.286707 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e1f33276-2009-49eb-8eb4-bd00d3b5133e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:38.450248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e1f33276-2009-49eb-8eb4-bd00d3b5133e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:38.458970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e1f33276-2009-49eb-8eb4-bd00d3b5133e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:38.460763 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e1f33276-2009-49eb-8eb4-bd00d3b5133e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:38.462095 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e1f33276-2009-49eb-8eb4-bd00d3b5133e tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.200183 May 09 23:08:38.462879 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 358/707] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:38 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:39.480877 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a923bd34-aa7d-457b-b994-53ff8fc765b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:39.481917 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a923bd34-aa7d-457b-b994-53ff8fc765b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:39.489085 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a923bd34-aa7d-457b-b994-53ff8fc765b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:39.489540 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a923bd34-aa7d-457b-b994-53ff8fc765b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:39.490348 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a923bd34-aa7d-457b-b994-53ff8fc765b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:39.490789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a923bd34-aa7d-457b-b994-53ff8fc765b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:39.627187 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a923bd34-aa7d-457b-b994-53ff8fc765b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:39.635903 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a923bd34-aa7d-457b-b994-53ff8fc765b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:39.637424 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a923bd34-aa7d-457b-b994-53ff8fc765b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:39.638770 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a923bd34-aa7d-457b-b994-53ff8fc765b3 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.162153 May 09 23:08:39.649256 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 359/708] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:39 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:08:40.289339 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-855b5daf-6f70-4285-af73-3b1b8ea380ea tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:40.289857 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-855b5daf-6f70-4285-af73-3b1b8ea380ea tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:40.297341 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-855b5daf-6f70-4285-af73-3b1b8ea380ea tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:40.297785 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-855b5daf-6f70-4285-af73-3b1b8ea380ea tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:40.298586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-855b5daf-6f70-4285-af73-3b1b8ea380ea tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:40.299015 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-855b5daf-6f70-4285-af73-3b1b8ea380ea tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:40.326804 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-855b5daf-6f70-4285-af73-3b1b8ea380ea tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/ips" status: 200 len: 145 microversion: 2.1 time: 0.041152 May 09 23:08:40.327636 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 360/709] 10.222.0.23 () {58 vars in 1247 bytes} [Mon May 9 23:08:40 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:08:40.656792 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-27fedcc5-f468-4489-af0e-56acfe677495 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:40.657658 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-27fedcc5-f468-4489-af0e-56acfe677495 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:40.663998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-27fedcc5-f468-4489-af0e-56acfe677495 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:40.664453 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-27fedcc5-f468-4489-af0e-56acfe677495 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:40.665243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-27fedcc5-f468-4489-af0e-56acfe677495 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:40.665674 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-27fedcc5-f468-4489-af0e-56acfe677495 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:40.810545 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-27fedcc5-f468-4489-af0e-56acfe677495 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:40.821702 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-27fedcc5-f468-4489-af0e-56acfe677495 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:40.824864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-27fedcc5-f468-4489-af0e-56acfe677495 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:40.826632 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-27fedcc5-f468-4489-af0e-56acfe677495 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.173695 May 09 23:08:40.827358 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 361/710] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:40 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:08:41.845724 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7fd660c7-4310-498c-87dc-030ae1772831 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:41.846951 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7fd660c7-4310-498c-87dc-030ae1772831 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:41.855714 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7fd660c7-4310-498c-87dc-030ae1772831 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:41.856430 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7fd660c7-4310-498c-87dc-030ae1772831 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:41.857220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7fd660c7-4310-498c-87dc-030ae1772831 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:41.857660 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7fd660c7-4310-498c-87dc-030ae1772831 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:42.000215 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7fd660c7-4310-498c-87dc-030ae1772831 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:42.009461 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7fd660c7-4310-498c-87dc-030ae1772831 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:42.010999 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7fd660c7-4310-498c-87dc-030ae1772831 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:42.012203 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7fd660c7-4310-498c-87dc-030ae1772831 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.170706 May 09 23:08:42.012946 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 362/711] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:41 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:08:43.151198 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f973721e-056c-4ed5-94d2-b140f9dc5240 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:43.152973 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f973721e-056c-4ed5-94d2-b140f9dc5240 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:43.161394 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f973721e-056c-4ed5-94d2-b140f9dc5240 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:43.162520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f973721e-056c-4ed5-94d2-b140f9dc5240 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:43.163708 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f973721e-056c-4ed5-94d2-b140f9dc5240 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:43.164460 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f973721e-056c-4ed5-94d2-b140f9dc5240 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:43.312391 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f973721e-056c-4ed5-94d2-b140f9dc5240 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:43.320519 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f973721e-056c-4ed5-94d2-b140f9dc5240 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:43.322047 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f973721e-056c-4ed5-94d2-b140f9dc5240 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:43.323423 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f973721e-056c-4ed5-94d2-b140f9dc5240 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.294272 May 09 23:08:43.323992 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 363/712] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:43 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:08:44.060938 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-8b17d12f-ae93-442f-b38a-03d5764686bf tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a645f0a7-0207-4f9a-9e9d-6026d7271561"}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:08:44.062488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-8b17d12f-ae93-442f-b38a-03d5764686bf tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:44.069221 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8b17d12f-ae93-442f-b38a-03d5764686bf tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:44.069667 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8b17d12f-ae93-442f-b38a-03d5764686bf tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:44.070474 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8b17d12f-ae93-442f-b38a-03d5764686bf tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:44.070906 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8b17d12f-ae93-442f-b38a-03d5764686bf tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:44.375030 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-eb3aa710-47ff-4b95-8e6d-82e913506bc0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "POST /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.086941 May 09 23:08:44.375670 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 350/713] 10.222.0.23 () {60 vars in 1322 bytes} [Mon May 9 23:08:35 2022] POST /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments => generated 194 bytes in 9088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:08:44.381725 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-02dc2818-7bd4-4c52-b64e-d7f1f476fe08 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:44.382450 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-02dc2818-7bd4-4c52-b64e-d7f1f476fe08 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:44.389232 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-02dc2818-7bd4-4c52-b64e-d7f1f476fe08 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:44.389689 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-02dc2818-7bd4-4c52-b64e-d7f1f476fe08 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:44.390518 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-02dc2818-7bd4-4c52-b64e-d7f1f476fe08 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:44.390963 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-02dc2818-7bd4-4c52-b64e-d7f1f476fe08 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:44.519305 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-02dc2818-7bd4-4c52-b64e-d7f1f476fe08 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:44.527047 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-02dc2818-7bd4-4c52-b64e-d7f1f476fe08 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:44.528494 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-02dc2818-7bd4-4c52-b64e-d7f1f476fe08 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:44.529652 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-02dc2818-7bd4-4c52-b64e-d7f1f476fe08 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.151976 May 09 23:08:44.530233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 351/714] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:44 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:45.195481 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-8b17d12f-ae93-442f-b38a-03d5764686bf tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "POST /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.138231 May 09 23:08:45.196447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 364/715] 10.222.0.23 () {60 vars in 1322 bytes} [Mon May 9 23:08:44 2022] POST /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/os-volume_attachments => generated 194 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:08:45.547579 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-af126bb4-b7a6-4660-bc00-8a7a4f8fd4cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:45.548191 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-af126bb4-b7a6-4660-bc00-8a7a4f8fd4cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:45.554407 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-af126bb4-b7a6-4660-bc00-8a7a4f8fd4cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:45.554855 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-af126bb4-b7a6-4660-bc00-8a7a4f8fd4cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:45.555612 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-af126bb4-b7a6-4660-bc00-8a7a4f8fd4cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:45.556041 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-af126bb4-b7a6-4660-bc00-8a7a4f8fd4cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:45.683494 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-af126bb4-b7a6-4660-bc00-8a7a4f8fd4cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:45.691870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-af126bb4-b7a6-4660-bc00-8a7a4f8fd4cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:45.693395 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-af126bb4-b7a6-4660-bc00-8a7a4f8fd4cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:45.694564 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-af126bb4-b7a6-4660-bc00-8a7a4f8fd4cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.150911 May 09 23:08:45.695131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 352/716] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:45 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:46.712970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f7c3aab2-d731-4676-8baf-25e77fbf9adb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:46.713676 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f7c3aab2-d731-4676-8baf-25e77fbf9adb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:46.720963 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f7c3aab2-d731-4676-8baf-25e77fbf9adb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:46.721413 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f7c3aab2-d731-4676-8baf-25e77fbf9adb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:46.722219 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f7c3aab2-d731-4676-8baf-25e77fbf9adb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:46.722659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f7c3aab2-d731-4676-8baf-25e77fbf9adb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:46.847614 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f7c3aab2-d731-4676-8baf-25e77fbf9adb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:46.855224 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f7c3aab2-d731-4676-8baf-25e77fbf9adb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:46.856998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f7c3aab2-d731-4676-8baf-25e77fbf9adb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:46.858174 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f7c3aab2-d731-4676-8baf-25e77fbf9adb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.149958 May 09 23:08:46.858743 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 365/717] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:46 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:47.877137 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1900e7f2-03ea-4193-99c7-db3cec78e6d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:47.877754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1900e7f2-03ea-4193-99c7-db3cec78e6d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:47.884030 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1900e7f2-03ea-4193-99c7-db3cec78e6d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:47.884485 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1900e7f2-03ea-4193-99c7-db3cec78e6d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:47.885260 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1900e7f2-03ea-4193-99c7-db3cec78e6d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:47.885693 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1900e7f2-03ea-4193-99c7-db3cec78e6d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:48.012025 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1900e7f2-03ea-4193-99c7-db3cec78e6d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:48.020329 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1900e7f2-03ea-4193-99c7-db3cec78e6d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:48.021837 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1900e7f2-03ea-4193-99c7-db3cec78e6d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:48.023025 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1900e7f2-03ea-4193-99c7-db3cec78e6d4 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.150043 May 09 23:08:48.023595 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 353/718] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:47 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:49.041526 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-42e9e6bb-ca52-4ef6-b28b-0a15e5d1f998 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:49.042184 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-42e9e6bb-ca52-4ef6-b28b-0a15e5d1f998 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:49.048443 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-42e9e6bb-ca52-4ef6-b28b-0a15e5d1f998 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:49.048888 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-42e9e6bb-ca52-4ef6-b28b-0a15e5d1f998 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:49.049643 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-42e9e6bb-ca52-4ef6-b28b-0a15e5d1f998 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:49.050071 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-42e9e6bb-ca52-4ef6-b28b-0a15e5d1f998 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:49.173772 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-42e9e6bb-ca52-4ef6-b28b-0a15e5d1f998 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:49.181421 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-42e9e6bb-ca52-4ef6-b28b-0a15e5d1f998 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:49.182935 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-42e9e6bb-ca52-4ef6-b28b-0a15e5d1f998 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:49.184071 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-42e9e6bb-ca52-4ef6-b28b-0a15e5d1f998 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.146377 May 09 23:08:49.184628 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 366/719] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:49 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:49.574984 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-622373a5-21c5-4fb3-83f1-fb67bc8167cf req-86f9d6c2-d0cf-41f8-a184-befa6bd6f8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cdc1269-4f55-47ba-8ebc-a403362e1962", "name": "network-vif-plugged", "status": "completed", "tag": "a898f67f-017d-433f-9c0f-e6793182e363"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:08:49.583933 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-622373a5-21c5-4fb3-83f1-fb67bc8167cf req-86f9d6c2-d0cf-41f8-a184-befa6bd6f8d2 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:49.584382 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-622373a5-21c5-4fb3-83f1-fb67bc8167cf req-86f9d6c2-d0cf-41f8-a184-befa6bd6f8d2 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:49.595295 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-622373a5-21c5-4fb3-83f1-fb67bc8167cf req-86f9d6c2-d0cf-41f8-a184-befa6bd6f8d2 service nova] Creating event network-vif-plugged:a898f67f-017d-433f-9c0f-e6793182e363 for instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 on hv-cinder-84067 May 09 23:08:49.600195 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-622373a5-21c5-4fb3-83f1-fb67bc8167cf req-86f9d6c2-d0cf-41f8-a184-befa6bd6f8d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028854 May 09 23:08:49.600734 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 354/720] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:08:50.201883 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-725b0cea-86d3-4d99-bd39-9e81e279acf2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:50.202552 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-725b0cea-86d3-4d99-bd39-9e81e279acf2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:50.208823 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-725b0cea-86d3-4d99-bd39-9e81e279acf2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:50.209268 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-725b0cea-86d3-4d99-bd39-9e81e279acf2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:50.210041 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-725b0cea-86d3-4d99-bd39-9e81e279acf2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:50.210505 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-725b0cea-86d3-4d99-bd39-9e81e279acf2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:50.337344 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-725b0cea-86d3-4d99-bd39-9e81e279acf2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:50.345491 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-725b0cea-86d3-4d99-bd39-9e81e279acf2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:50.347030 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-725b0cea-86d3-4d99-bd39-9e81e279acf2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:50.348186 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-725b0cea-86d3-4d99-bd39-9e81e279acf2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.150179 May 09 23:08:50.348752 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 367/721] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:50 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:51.366813 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-82a52d59-ca3c-4304-a3b6-fdf7ccc4eddf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:51.367636 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-82a52d59-ca3c-4304-a3b6-fdf7ccc4eddf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:51.373624 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-82a52d59-ca3c-4304-a3b6-fdf7ccc4eddf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:51.374068 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-82a52d59-ca3c-4304-a3b6-fdf7ccc4eddf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:51.374861 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-82a52d59-ca3c-4304-a3b6-fdf7ccc4eddf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:51.375292 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-82a52d59-ca3c-4304-a3b6-fdf7ccc4eddf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:51.765992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-82a52d59-ca3c-4304-a3b6-fdf7ccc4eddf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:51.773605 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-82a52d59-ca3c-4304-a3b6-fdf7ccc4eddf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:51.775122 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-82a52d59-ca3c-4304-a3b6-fdf7ccc4eddf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:51.776261 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-82a52d59-ca3c-4304-a3b6-fdf7ccc4eddf tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1730 microversion: 2.20 time: 0.414092 May 09 23:08:51.776825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 355/722] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:51 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1730 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:52.794989 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2f8226d8-de59-4609-9442-9f8fc9eef969 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:52.795603 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2f8226d8-de59-4609-9442-9f8fc9eef969 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:52.802700 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2f8226d8-de59-4609-9442-9f8fc9eef969 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:52.803148 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2f8226d8-de59-4609-9442-9f8fc9eef969 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:52.803944 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2f8226d8-de59-4609-9442-9f8fc9eef969 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:52.804375 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2f8226d8-de59-4609-9442-9f8fc9eef969 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:52.935871 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2f8226d8-de59-4609-9442-9f8fc9eef969 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:52.943785 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2f8226d8-de59-4609-9442-9f8fc9eef969 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:52.945255 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2f8226d8-de59-4609-9442-9f8fc9eef969 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:52.946451 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2f8226d8-de59-4609-9442-9f8fc9eef969 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1717 microversion: 2.20 time: 0.155416 May 09 23:08:52.946999 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 368/723] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:08:52 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:08:52.996316 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e0ef9d10-45c1-4e42-bfb8-fb2e92ae6601 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:52.996811 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e0ef9d10-45c1-4e42-bfb8-fb2e92ae6601 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:53.002988 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e0ef9d10-45c1-4e42-bfb8-fb2e92ae6601 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:53.003441 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e0ef9d10-45c1-4e42-bfb8-fb2e92ae6601 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:53.004213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e0ef9d10-45c1-4e42-bfb8-fb2e92ae6601 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:53.004650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e0ef9d10-45c1-4e42-bfb8-fb2e92ae6601 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:53.081055 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-e0ef9d10-45c1-4e42-bfb8-fb2e92ae6601 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lazy-loading 'services' on Instance uuid 791da3e3-267a-4bdd-9761-386c1061811e {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:08:53.148942 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e0ef9d10-45c1-4e42-bfb8-fb2e92ae6601 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments/eb02b9b2-d5a5-496e-b9f1-b981af78ce17" status: 202 len: 0 microversion: 2.1 time: 0.156317 May 09 23:08:53.149914 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 356/724] 10.222.0.23 () {58 vars in 1415 bytes} [Mon May 9 23:08:52 2022] DELETE /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments/eb02b9b2-d5a5-496e-b9f1-b981af78ce17 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:08:53.158819 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-77d203be-3cc1-495d-863d-68fa145cca9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:53.159806 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-77d203be-3cc1-495d-863d-68fa145cca9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:53.165874 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-77d203be-3cc1-495d-863d-68fa145cca9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:53.166480 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-77d203be-3cc1-495d-863d-68fa145cca9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:53.167408 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-77d203be-3cc1-495d-863d-68fa145cca9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:53.167865 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-77d203be-3cc1-495d-863d-68fa145cca9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:53.197629 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-77d203be-3cc1-495d-863d-68fa145cca9e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043276 May 09 23:08:53.198332 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 369/725] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:08:53 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:08:54.209098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-8df67a1c-d484-442b-b07e-82e749dcd55f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:54.210175 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-8df67a1c-d484-442b-b07e-82e749dcd55f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:54.216649 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8df67a1c-d484-442b-b07e-82e749dcd55f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:54.217093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8df67a1c-d484-442b-b07e-82e749dcd55f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:54.217851 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8df67a1c-d484-442b-b07e-82e749dcd55f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:54.218314 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8df67a1c-d484-442b-b07e-82e749dcd55f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:54.246044 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-8df67a1c-d484-442b-b07e-82e749dcd55f tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041298 May 09 23:08:54.246623 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 357/726] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:08:54 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:08:55.259480 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-34134544-b37b-4a76-949a-9dde492f6d92 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:55.260399 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-34134544-b37b-4a76-949a-9dde492f6d92 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:55.266690 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-34134544-b37b-4a76-949a-9dde492f6d92 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:55.267137 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-34134544-b37b-4a76-949a-9dde492f6d92 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:55.267902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-34134544-b37b-4a76-949a-9dde492f6d92 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:55.268337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-34134544-b37b-4a76-949a-9dde492f6d92 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:55.296339 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-34134544-b37b-4a76-949a-9dde492f6d92 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040812 May 09 23:08:55.296891 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 370/727] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:08:55 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:08:56.307957 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-8e7e34a5-1f55-499d-8d0e-d29823795fb4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:56.308865 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-8e7e34a5-1f55-499d-8d0e-d29823795fb4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:56.315164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8e7e34a5-1f55-499d-8d0e-d29823795fb4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:56.315612 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8e7e34a5-1f55-499d-8d0e-d29823795fb4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:56.316370 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8e7e34a5-1f55-499d-8d0e-d29823795fb4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:56.316801 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8e7e34a5-1f55-499d-8d0e-d29823795fb4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:56.345182 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-8e7e34a5-1f55-499d-8d0e-d29823795fb4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040503 May 09 23:08:56.345734 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 358/728] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:08:56 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:08:57.356927 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-9ba28a6b-c0dd-473c-a6b8-44a0554f7d5d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:57.357847 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-9ba28a6b-c0dd-473c-a6b8-44a0554f7d5d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:57.364155 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9ba28a6b-c0dd-473c-a6b8-44a0554f7d5d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:57.364606 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9ba28a6b-c0dd-473c-a6b8-44a0554f7d5d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:57.365374 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9ba28a6b-c0dd-473c-a6b8-44a0554f7d5d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:57.365808 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9ba28a6b-c0dd-473c-a6b8-44a0554f7d5d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:57.396136 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-9ba28a6b-c0dd-473c-a6b8-44a0554f7d5d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043397 May 09 23:08:57.396691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 371/729] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:08:57 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:08:58.408376 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9097acce-9f4b-4281-9df9-227cc2d2a7af tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:58.409209 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9097acce-9f4b-4281-9df9-227cc2d2a7af tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:58.415499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9097acce-9f4b-4281-9df9-227cc2d2a7af tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:58.415947 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9097acce-9f4b-4281-9df9-227cc2d2a7af tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:58.416751 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9097acce-9f4b-4281-9df9-227cc2d2a7af tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:58.417190 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9097acce-9f4b-4281-9df9-227cc2d2a7af tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:58.446467 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9097acce-9f4b-4281-9df9-227cc2d2a7af tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042526 May 09 23:08:58.447040 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 359/730] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:08:58 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:08:58.986040 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-23a4eb11-3cce-4da3-bf2c-a3c2b6d36786 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:08:58.992331 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-23a4eb11-3cce-4da3-bf2c-a3c2b6d36786 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:58.992773 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-23a4eb11-3cce-4da3-bf2c-a3c2b6d36786 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:59.050092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-23a4eb11-3cce-4da3-bf2c-a3c2b6d36786 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Going to try to stop instance {{(pid=117143) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 09 23:08:59.090917 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-23a4eb11-3cce-4da3-bf2c-a3c2b6d36786 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "POST /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/action" status: 202 len: 0 microversion: 2.1 time: 0.108704 May 09 23:08:59.091555 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 372/731] 10.222.0.23 () {60 vars in 1277 bytes} [Mon May 9 23:08:58 2022] POST /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:08:59.099496 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-aa6e910f-ba7c-411c-b49e-56088aef1d1e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:59.100108 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-aa6e910f-ba7c-411c-b49e-56088aef1d1e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:59.105839 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-aa6e910f-ba7c-411c-b49e-56088aef1d1e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:59.106582 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-aa6e910f-ba7c-411c-b49e-56088aef1d1e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:59.107364 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-aa6e910f-ba7c-411c-b49e-56088aef1d1e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:59.107785 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-aa6e910f-ba7c-411c-b49e-56088aef1d1e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:59.232977 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-aa6e910f-ba7c-411c-b49e-56088aef1d1e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:59.241215 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-aa6e910f-ba7c-411c-b49e-56088aef1d1e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1720 microversion: 2.1 time: 0.145497 May 09 23:08:59.241782 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 360/732] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:08:59 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1720 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:08:59.459235 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-327989ae-6dcd-4683-901a-717aebbd7021 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:59.460248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-327989ae-6dcd-4683-901a-717aebbd7021 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:59.466350 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-327989ae-6dcd-4683-901a-717aebbd7021 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:59.466819 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-327989ae-6dcd-4683-901a-717aebbd7021 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:59.467573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-327989ae-6dcd-4683-901a-717aebbd7021 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:59.468011 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-327989ae-6dcd-4683-901a-717aebbd7021 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:59.496465 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-327989ae-6dcd-4683-901a-717aebbd7021 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042195 May 09 23:08:59.497024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 373/733] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:08:59 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 23:08:59.552938 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-23a23872-6d35-47e5-858a-cf9705faef01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:59.553429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-23a23872-6d35-47e5-858a-cf9705faef01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:59.559717 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-23a23872-6d35-47e5-858a-cf9705faef01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:59.560171 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-23a23872-6d35-47e5-858a-cf9705faef01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:59.560939 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-23a23872-6d35-47e5-858a-cf9705faef01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:59.561377 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-23a23872-6d35-47e5-858a-cf9705faef01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:59.586562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-23a23872-6d35-47e5-858a-cf9705faef01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Going to try to terminate instance {{(pid=117142) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:08:59.661468 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-23a23872-6d35-47e5-858a-cf9705faef01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 204 len: 0 microversion: 2.1 time: 0.111978 May 09 23:08:59.662342 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 361/734] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:08:59 2022] DELETE /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:08:59.670319 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d91f16e2-ea1f-4916-b8f7-89b9de0dfe9d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:08:59.670922 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d91f16e2-ea1f-4916-b8f7-89b9de0dfe9d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:08:59.676676 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d91f16e2-ea1f-4916-b8f7-89b9de0dfe9d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:59.677119 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d91f16e2-ea1f-4916-b8f7-89b9de0dfe9d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:59.677868 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d91f16e2-ea1f-4916-b8f7-89b9de0dfe9d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:08:59.678352 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d91f16e2-ea1f-4916-b8f7-89b9de0dfe9d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:08:59.803384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d91f16e2-ea1f-4916-b8f7-89b9de0dfe9d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:08:59.810557 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d91f16e2-ea1f-4916-b8f7-89b9de0dfe9d tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 200 len: 1681 microversion: 2.1 time: 0.144060 May 09 23:08:59.811117 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 374/735] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:08:59 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 1681 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:00.259130 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fe40e027-0913-4be6-a6bc-6490e6f310eb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:00.259829 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-fe40e027-0913-4be6-a6bc-6490e6f310eb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:00.265658 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fe40e027-0913-4be6-a6bc-6490e6f310eb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:00.266130 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fe40e027-0913-4be6-a6bc-6490e6f310eb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:00.266907 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fe40e027-0913-4be6-a6bc-6490e6f310eb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:00.267345 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fe40e027-0913-4be6-a6bc-6490e6f310eb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:00.396582 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-fe40e027-0913-4be6-a6bc-6490e6f310eb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:00.404301 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-fe40e027-0913-4be6-a6bc-6490e6f310eb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1720 microversion: 2.1 time: 0.149486 May 09 23:09:00.404885 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 362/736] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:00 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:00.828129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-45339eed-521a-4e7c-aefe-6be6046f8f6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:00.828740 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-45339eed-521a-4e7c-aefe-6be6046f8f6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:00.835482 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-45339eed-521a-4e7c-aefe-6be6046f8f6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:00.835930 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-45339eed-521a-4e7c-aefe-6be6046f8f6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:00.836692 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-45339eed-521a-4e7c-aefe-6be6046f8f6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:00.837160 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-45339eed-521a-4e7c-aefe-6be6046f8f6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:00.961087 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-45339eed-521a-4e7c-aefe-6be6046f8f6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:00.968418 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-45339eed-521a-4e7c-aefe-6be6046f8f6e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 200 len: 1681 microversion: 2.1 time: 0.144157 May 09 23:09:00.968988 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 375/737] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:00 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 1681 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:01.422039 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ecb788ba-065c-48ff-9489-6082e0dc43fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:01.422679 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ecb788ba-065c-48ff-9489-6082e0dc43fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:01.429458 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ecb788ba-065c-48ff-9489-6082e0dc43fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:01.429903 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ecb788ba-065c-48ff-9489-6082e0dc43fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:01.430707 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ecb788ba-065c-48ff-9489-6082e0dc43fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:01.431131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ecb788ba-065c-48ff-9489-6082e0dc43fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:01.556504 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ecb788ba-065c-48ff-9489-6082e0dc43fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:01.564175 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ecb788ba-065c-48ff-9489-6082e0dc43fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1720 microversion: 2.1 time: 0.145921 May 09 23:09:01.564752 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 363/738] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:01 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1720 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:01.987752 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b86caaf2-1126-473c-9eb9-315685f4cb01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:01.988582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b86caaf2-1126-473c-9eb9-315685f4cb01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:01.994765 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b86caaf2-1126-473c-9eb9-315685f4cb01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:01.995215 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b86caaf2-1126-473c-9eb9-315685f4cb01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:01.995983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b86caaf2-1126-473c-9eb9-315685f4cb01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:01.996418 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b86caaf2-1126-473c-9eb9-315685f4cb01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:02.214852 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b86caaf2-1126-473c-9eb9-315685f4cb01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a45506c19c4cda8173c164a097f925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b776734a879d4c0785b1d3728b79b766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:02.222820 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b86caaf2-1126-473c-9eb9-315685f4cb01 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 200 len: 1681 microversion: 2.1 time: 0.239984 May 09 23:09:02.223404 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 376/739] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:01 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 1681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:02.506680 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-929383e2-53d0-44e3-adad-4b597837a62d req-a0c5c8eb-9308-4bf2-ac73-76d50e172963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791da3e3-267a-4bdd-9761-386c1061811e", "name": "network-vif-deleted", "tag": "79d9a4b3-de1a-4fc9-bd91-29fa1550dc38"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:09:02.522876 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-929383e2-53d0-44e3-adad-4b597837a62d req-a0c5c8eb-9308-4bf2-ac73-76d50e172963 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:02.523524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-929383e2-53d0-44e3-adad-4b597837a62d req-a0c5c8eb-9308-4bf2-ac73-76d50e172963 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:02.542959 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-929383e2-53d0-44e3-adad-4b597837a62d req-a0c5c8eb-9308-4bf2-ac73-76d50e172963 service nova] Creating event network-vif-deleted:79d9a4b3-de1a-4fc9-bd91-29fa1550dc38 for instance 791da3e3-267a-4bdd-9761-386c1061811e on hv-cinder-84067 May 09 23:09:02.551459 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-929383e2-53d0-44e3-adad-4b597837a62d req-a0c5c8eb-9308-4bf2-ac73-76d50e172963 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118336 May 09 23:09:02.555443 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 364/740] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:09:02.583478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-591b20eb-5605-44ee-a73d-4e7096287a8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:02.584105 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-591b20eb-5605-44ee-a73d-4e7096287a8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:02.600078 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-591b20eb-5605-44ee-a73d-4e7096287a8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:02.600826 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-591b20eb-5605-44ee-a73d-4e7096287a8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:02.601906 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-591b20eb-5605-44ee-a73d-4e7096287a8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:02.602424 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-591b20eb-5605-44ee-a73d-4e7096287a8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:02.741115 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-591b20eb-5605-44ee-a73d-4e7096287a8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:02.748907 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-591b20eb-5605-44ee-a73d-4e7096287a8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1720 microversion: 2.1 time: 0.171666 May 09 23:09:02.749483 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 377/741] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:02 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:09:03.240722 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9cbc442f-ece3-4c71-8924-02a31891fffd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:03.241593 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9cbc442f-ece3-4c71-8924-02a31891fffd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:03.248213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9cbc442f-ece3-4c71-8924-02a31891fffd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:03.248662 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9cbc442f-ece3-4c71-8924-02a31891fffd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:03.249443 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9cbc442f-ece3-4c71-8924-02a31891fffd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:03.249877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9cbc442f-ece3-4c71-8924-02a31891fffd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:03.264190 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-9cbc442f-ece3-4c71-8924-02a31891fffd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] HTTP exception thrown: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9cbc442f-ece3-4c71-8924-02a31891fffd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Request method failure captured: May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e HTTP/1.1 May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ2AZq5EfNRX4A2tCiVwicbnfgrKkrL1gKGZ2i9kDkpeQEVnPD6CHxNPMLHcnk-nNrqb42O05Dml9fFcVJ8tZC-e8-FzgQMzIs0cjdHVhCDJH8lgSgXK8gUI8fFy_4mLaumbFrU7L_T2O0x7fdFRFsthOIPJ0V_6K6OxmafCQoxWJqE May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:09:03.265994 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:09:03.268320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b776734a879d4c0785b1d3728b79b766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:09:03.268320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:03.268320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:03.268320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:03.268320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:03.268320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:09:03.268320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:09:03.268320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 84a45506c19c4cda8173c164a097f925 May 09 23:09:03.268320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:03.268320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:09:03.268320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:03.268320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '791da3e3-267a-4bdd-9761-386c1061811e'} May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:09:03.269093 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:03.270360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:03.271467 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9cbc442f-ece3-4c71-8924-02a31891fffd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Returning 404 to user: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:09:03.271467 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9cbc442f-ece3-4c71-8924-02a31891fffd tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 404 len: 111 microversion: 2.1 time: 0.031455 May 09 23:09:03.271467 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 365/742] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:03 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:09:03.277144 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a5ebae6e-ae18-4892-a7fa-4bb0022b0da7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '.version_select at 0x7fc298177700>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:03.295580 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a5ebae6e-ae18-4892-a7fa-4bb0022b0da7 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-751187037" status: 202 len: 0 microversion: 2.1 time: 0.022358 May 09 23:09:03.296167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 378/743] 10.222.0.23 () {58 vars in 1217 bytes} [Mon May 9 23:09:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-751187037 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:09:03.766638 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-97ddf1e3-e504-4612-a9d3-c909552db48c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:03.767270 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-97ddf1e3-e504-4612-a9d3-c909552db48c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:03.773535 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-97ddf1e3-e504-4612-a9d3-c909552db48c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:03.773986 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-97ddf1e3-e504-4612-a9d3-c909552db48c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:03.774782 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-97ddf1e3-e504-4612-a9d3-c909552db48c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:03.775217 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-97ddf1e3-e504-4612-a9d3-c909552db48c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:03.907304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-97ddf1e3-e504-4612-a9d3-c909552db48c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:03.918801 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-97ddf1e3-e504-4612-a9d3-c909552db48c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1720 microversion: 2.1 time: 0.156018 May 09 23:09:03.919379 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 366/744] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:03 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:04.937105 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0061a6e7-c379-4211-96df-c277f8f3c831 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:04.937626 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-0061a6e7-c379-4211-96df-c277f8f3c831 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:04.946839 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0061a6e7-c379-4211-96df-c277f8f3c831 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:04.947292 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0061a6e7-c379-4211-96df-c277f8f3c831 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:04.948059 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0061a6e7-c379-4211-96df-c277f8f3c831 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:04.948499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0061a6e7-c379-4211-96df-c277f8f3c831 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:05.035804 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-03cf3649-ebd3-468c-916a-abc45d98a8d5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:05.036305 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-03cf3649-ebd3-468c-916a-abc45d98a8d5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:05.042881 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-03cf3649-ebd3-468c-916a-abc45d98a8d5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:05.043341 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-03cf3649-ebd3-468c-916a-abc45d98a8d5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:05.044150 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-03cf3649-ebd3-468c-916a-abc45d98a8d5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:05.044593 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-03cf3649-ebd3-468c-916a-abc45d98a8d5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:05.058287 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-03cf3649-ebd3-468c-916a-abc45d98a8d5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] HTTP exception thrown: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-03cf3649-ebd3-468c-916a-abc45d98a8d5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Request method failure captured: May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: DELETE /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e HTTP/1.1 May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ2AZq5EfNRX4A2tCiVwicbnfgrKkrL1gKGZ2i9kDkpeQEVnPD6CHxNPMLHcnk-nNrqb42O05Dml9fFcVJ8tZC-e8-FzgQMzIs0cjdHVhCDJH8lgSgXK8gUI8fFy_4mLaumbFrU7L_T2O0x7fdFRFsthOIPJ0V_6K6OxmafCQoxWJqE May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:09:05.059841 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:09:05.061247 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b776734a879d4c0785b1d3728b79b766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:09:05.061247 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:05.061247 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:05.061247 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:05.061247 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:05.061247 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:09:05.061247 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:09:05.061247 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 84a45506c19c4cda8173c164a097f925 May 09 23:09:05.061247 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:05.061247 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:09:05.061247 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:05.061247 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '791da3e3-267a-4bdd-9761-386c1061811e'} May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:09:05.062106 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:05.063492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:05.064863 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-03cf3649-ebd3-468c-916a-abc45d98a8d5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Returning 404 to user: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:09:05.064863 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-03cf3649-ebd3-468c-916a-abc45d98a8d5 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 404 len: 111 microversion: 2.1 time: 0.029728 May 09 23:09:05.064863 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 367/745] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:09:05 2022] DELETE /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 23:09:05.069262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-43648f3e-973a-4152-baf3-d89f9c40804e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:05.069870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-43648f3e-973a-4152-baf3-d89f9c40804e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 791da3e3-267a-4bdd-9761-386c1061811e] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:05.075582 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-43648f3e-973a-4152-baf3-d89f9c40804e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:05.075991 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-43648f3e-973a-4152-baf3-d89f9c40804e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:05.076763 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-43648f3e-973a-4152-baf3-d89f9c40804e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:05.077202 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-43648f3e-973a-4152-baf3-d89f9c40804e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:05.078518 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-0061a6e7-c379-4211-96df-c277f8f3c831 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:05.086346 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-0061a6e7-c379-4211-96df-c277f8f3c831 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1720 microversion: 2.1 time: 0.153534 May 09 23:09:05.086919 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 379/746] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:04 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:05.090522 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-43648f3e-973a-4152-baf3-d89f9c40804e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] HTTP exception thrown: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-43648f3e-973a-4152-baf3-d89f9c40804e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Request method failure captured: May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e HTTP/1.1 May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ2AZq5EfNRX4A2tCiVwicbnfgrKkrL1gKGZ2i9kDkpeQEVnPD6CHxNPMLHcnk-nNrqb42O05Dml9fFcVJ8tZC-e8-FzgQMzIs0cjdHVhCDJH8lgSgXK8gUI8fFy_4mLaumbFrU7L_T2O0x7fdFRFsthOIPJ0V_6K6OxmafCQoxWJqE May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:09:05.092033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:09:05.093543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b776734a879d4c0785b1d3728b79b766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:09:05.093543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:05.093543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:05.093543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:05.093543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:05.093543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:09:05.093543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:09:05.093543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 84a45506c19c4cda8173c164a097f925 May 09 23:09:05.093543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:05.093543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:09:05.093543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:05.093543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '791da3e3-267a-4bdd-9761-386c1061811e'} May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:09:05.094562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. May 09 23:09:05.096873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:05.098266 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-43648f3e-973a-4152-baf3-d89f9c40804e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Returning 404 to user: Instance 791da3e3-267a-4bdd-9761-386c1061811e could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:09:05.098266 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-43648f3e-973a-4152-baf3-d89f9c40804e tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e" status: 404 len: 111 microversion: 2.1 time: 0.027712 May 09 23:09:05.098266 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 368/747] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:05 2022] GET /compute/v2.1/servers/791da3e3-267a-4bdd-9761-386c1061811e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:09:06.103949 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e16afbb3-aaac-4142-bb4f-0700ef552a05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:06.104565 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e16afbb3-aaac-4142-bb4f-0700ef552a05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:06.111725 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e16afbb3-aaac-4142-bb4f-0700ef552a05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:06.112176 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e16afbb3-aaac-4142-bb4f-0700ef552a05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:06.112941 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e16afbb3-aaac-4142-bb4f-0700ef552a05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:06.113381 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e16afbb3-aaac-4142-bb4f-0700ef552a05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:06.222746 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-03e1ba5a-3b37-47a7-85d6-74ea630fd9e2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:06.223261 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-03e1ba5a-3b37-47a7-85d6-74ea630fd9e2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:06.229377 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-03e1ba5a-3b37-47a7-85d6-74ea630fd9e2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:06.229831 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-03e1ba5a-3b37-47a7-85d6-74ea630fd9e2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:06.230634 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-03e1ba5a-3b37-47a7-85d6-74ea630fd9e2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:06.231338 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-03e1ba5a-3b37-47a7-85d6-74ea630fd9e2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:06.238951 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e16afbb3-aaac-4142-bb4f-0700ef552a05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:06.245519 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-03e1ba5a-3b37-47a7-85d6-74ea630fd9e2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] HTTP exception thrown: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:09:06.246613 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e16afbb3-aaac-4142-bb4f-0700ef552a05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1720 microversion: 2.1 time: 0.146519 May 09 23:09:06.247186 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 380/748] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:06 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-03e1ba5a-3b37-47a7-85d6-74ea630fd9e2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Request method failure captured: May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: DELETE /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa HTTP/1.1 May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ2AZq5EfNRX4A2tCiVwicbnfgrKkrL1gKGZ2i9kDkpeQEVnPD6CHxNPMLHcnk-nNrqb42O05Dml9fFcVJ8tZC-e8-FzgQMzIs0cjdHVhCDJH8lgSgXK8gUI8fFy_4mLaumbFrU7L_T2O0x7fdFRFsthOIPJ0V_6K6OxmafCQoxWJqE May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:09:06.247313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:09:06.248772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b776734a879d4c0785b1d3728b79b766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:09:06.248772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:06.248772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:06.248772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:06.248772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:06.248772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:09:06.248772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:09:06.248772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 84a45506c19c4cda8173c164a097f925 May 09 23:09:06.248772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:06.248772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:09:06.248772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:09:06.248772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '31ea1b8e-49ff-4716-8cbf-ca11225258aa'} May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:09:06.249780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:09:06.251877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:06.254362 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-03e1ba5a-3b37-47a7-85d6-74ea630fd9e2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Returning 404 to user: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:09:06.254362 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-03e1ba5a-3b37-47a7-85d6-74ea630fd9e2 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 404 len: 111 microversion: 2.1 time: 0.029754 May 09 23:09:06.254362 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 369/749] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:09:06 2022] DELETE /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:09:06.257234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ed2524ec-c3f6-4487-ac5f-8ec5a7b1b6f0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:06.257842 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ed2524ec-c3f6-4487-ac5f-8ec5a7b1b6f0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: 31ea1b8e-49ff-4716-8cbf-ca11225258aa] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:06.263584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ed2524ec-c3f6-4487-ac5f-8ec5a7b1b6f0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:06.264034 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ed2524ec-c3f6-4487-ac5f-8ec5a7b1b6f0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:06.264801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ed2524ec-c3f6-4487-ac5f-8ec5a7b1b6f0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:06.265237 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ed2524ec-c3f6-4487-ac5f-8ec5a7b1b6f0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:06.277933 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-ed2524ec-c3f6-4487-ac5f-8ec5a7b1b6f0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] HTTP exception thrown: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ed2524ec-c3f6-4487-ac5f-8ec5a7b1b6f0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Request method failure captured: May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa HTTP/1.1 May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ2AZq5EfNRX4A2tCiVwicbnfgrKkrL1gKGZ2i9kDkpeQEVnPD6CHxNPMLHcnk-nNrqb42O05Dml9fFcVJ8tZC-e8-FzgQMzIs0cjdHVhCDJH8lgSgXK8gUI8fFy_4mLaumbFrU7L_T2O0x7fdFRFsthOIPJ0V_6K6OxmafCQoxWJqE May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:09:06.279571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:09:06.281083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b776734a879d4c0785b1d3728b79b766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:09:06.281083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:06.281083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:06.281083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:06.281083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:06.281083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:09:06.281083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:09:06.281083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 84a45506c19c4cda8173c164a097f925 May 09 23:09:06.281083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:06.281083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:09:06.281083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:09:06.281083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': '31ea1b8e-49ff-4716-8cbf-ca11225258aa'} May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:09:06.282086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. May 09 23:09:06.284037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:06.285305 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ed2524ec-c3f6-4487-ac5f-8ec5a7b1b6f0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Returning 404 to user: Instance 31ea1b8e-49ff-4716-8cbf-ca11225258aa could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:09:06.285305 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ed2524ec-c3f6-4487-ac5f-8ec5a7b1b6f0 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa" status: 404 len: 111 microversion: 2.1 time: 0.027208 May 09 23:09:06.285305 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 381/750] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:06 2022] GET /compute/v2.1/servers/31ea1b8e-49ff-4716-8cbf-ca11225258aa => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:09:06.295490 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-7b270de6-a047-4328-9066-2858920905fa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:06.296001 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-7b270de6-a047-4328-9066-2858920905fa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:06.303404 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7b270de6-a047-4328-9066-2858920905fa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:06.303848 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7b270de6-a047-4328-9066-2858920905fa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:06.304618 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7b270de6-a047-4328-9066-2858920905fa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:06.305082 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7b270de6-a047-4328-9066-2858920905fa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:06.319958 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-7b270de6-a047-4328-9066-2858920905fa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] HTTP exception thrown: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-7b270de6-a047-4328-9066-2858920905fa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Request method failure captured: May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: DELETE /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 HTTP/1.1 May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ2AZq5EfNRX4A2tCiVwicbnfgrKkrL1gKGZ2i9kDkpeQEVnPD6CHxNPMLHcnk-nNrqb42O05Dml9fFcVJ8tZC-e8-FzgQMzIs0cjdHVhCDJH8lgSgXK8gUI8fFy_4mLaumbFrU7L_T2O0x7fdFRFsthOIPJ0V_6K6OxmafCQoxWJqE May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:09:06.321513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:09:06.323131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b776734a879d4c0785b1d3728b79b766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:09:06.323131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:06.323131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:06.323131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:06.323131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:06.323131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:09:06.323131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:09:06.323131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 84a45506c19c4cda8173c164a097f925 May 09 23:09:06.323131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:06.323131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:09:06.323131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:09:06.323131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': 'a46c08db-d64b-4794-85f2-3ade7544e841'} May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:09:06.324148 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:09:06.325596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:06.327399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-7b270de6-a047-4328-9066-2858920905fa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Returning 404 to user: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:09:06.327399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-7b270de6-a047-4328-9066-2858920905fa tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 404 len: 111 microversion: 2.1 time: 0.034794 May 09 23:09:06.327399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 370/751] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:09:06 2022] DELETE /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:09:06.331254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-232227b2-1922-4f6c-88c6-3d24334b4306 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:06.331894 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-232227b2-1922-4f6c-88c6-3d24334b4306 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: a46c08db-d64b-4794-85f2-3ade7544e841] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:06.337661 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-232227b2-1922-4f6c-88c6-3d24334b4306 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:06.338133 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-232227b2-1922-4f6c-88c6-3d24334b4306 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:06.338894 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-232227b2-1922-4f6c-88c6-3d24334b4306 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:06.339350 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-232227b2-1922-4f6c-88c6-3d24334b4306 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:06.352741 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-232227b2-1922-4f6c-88c6-3d24334b4306 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] HTTP exception thrown: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-232227b2-1922-4f6c-88c6-3d24334b4306 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Request method failure captured: May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 HTTP/1.1 May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ2AZq5EfNRX4A2tCiVwicbnfgrKkrL1gKGZ2i9kDkpeQEVnPD6CHxNPMLHcnk-nNrqb42O05Dml9fFcVJ8tZC-e8-FzgQMzIs0cjdHVhCDJH8lgSgXK8gUI8fFy_4mLaumbFrU7L_T2O0x7fdFRFsthOIPJ0V_6K6OxmafCQoxWJqE May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:09:06.354271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:09:06.355789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b776734a879d4c0785b1d3728b79b766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:09:06.355789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:06.355789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:06.355789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:06.355789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:06.355789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:09:06.355789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:09:06.355789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 84a45506c19c4cda8173c164a097f925 May 09 23:09:06.355789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:06.355789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:09:06.355789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:09:06.355789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': 'a46c08db-d64b-4794-85f2-3ade7544e841'} May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:09:06.357194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. May 09 23:09:06.358652 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:06.361417 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-232227b2-1922-4f6c-88c6-3d24334b4306 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Returning 404 to user: Instance a46c08db-d64b-4794-85f2-3ade7544e841 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:09:06.361417 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-232227b2-1922-4f6c-88c6-3d24334b4306 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841" status: 404 len: 111 microversion: 2.1 time: 0.028059 May 09 23:09:06.361417 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 382/752] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:06 2022] GET /compute/v2.1/servers/a46c08db-d64b-4794-85f2-3ade7544e841 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:09:07.263591 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0ad19dae-9d5f-4c03-ae9c-6737b5c453c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:07.264123 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-0ad19dae-9d5f-4c03-ae9c-6737b5c453c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:07.270419 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0ad19dae-9d5f-4c03-ae9c-6737b5c453c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:07.270868 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0ad19dae-9d5f-4c03-ae9c-6737b5c453c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:07.271635 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0ad19dae-9d5f-4c03-ae9c-6737b5c453c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:07.272068 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0ad19dae-9d5f-4c03-ae9c-6737b5c453c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:07.404275 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-0ad19dae-9d5f-4c03-ae9c-6737b5c453c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:07.412509 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0ad19dae-9d5f-4c03-ae9c-6737b5c453c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1720 microversion: 2.1 time: 0.152819 May 09 23:09:07.413072 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 371/753] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:07 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:07.487444 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2ce65545-8cfe-46b4-a99a-5cf1c1505db4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:07.487981 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2ce65545-8cfe-46b4-a99a-5cf1c1505db4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:07.494326 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2ce65545-8cfe-46b4-a99a-5cf1c1505db4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:07.494779 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2ce65545-8cfe-46b4-a99a-5cf1c1505db4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:07.495553 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2ce65545-8cfe-46b4-a99a-5cf1c1505db4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:07.495989 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2ce65545-8cfe-46b4-a99a-5cf1c1505db4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:07.508954 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-2ce65545-8cfe-46b4-a99a-5cf1c1505db4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] HTTP exception thrown: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2ce65545-8cfe-46b4-a99a-5cf1c1505db4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Request method failure captured: May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: DELETE /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 HTTP/1.1 May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ2AZq5EfNRX4A2tCiVwicbnfgrKkrL1gKGZ2i9kDkpeQEVnPD6CHxNPMLHcnk-nNrqb42O05Dml9fFcVJ8tZC-e8-FzgQMzIs0cjdHVhCDJH8lgSgXK8gUI8fFy_4mLaumbFrU7L_T2O0x7fdFRFsthOIPJ0V_6K6OxmafCQoxWJqE May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:09:07.510524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:09:07.512040 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b776734a879d4c0785b1d3728b79b766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:09:07.512040 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:07.512040 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:07.512040 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:07.512040 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:07.512040 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:09:07.512040 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:09:07.512040 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 84a45506c19c4cda8173c164a097f925 May 09 23:09:07.512040 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:07.512040 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:09:07.512040 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:09:07.512040 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': 'da290c35-0f36-4420-aaf8-d18fd9b906f0'} May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:09:07.512902 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:09:07.514223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:07.515484 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2ce65545-8cfe-46b4-a99a-5cf1c1505db4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Returning 404 to user: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:09:07.515484 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2ce65545-8cfe-46b4-a99a-5cf1c1505db4 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "DELETE /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 404 len: 111 microversion: 2.1 time: 0.028239 May 09 23:09:07.515484 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 383/754] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:09:07 2022] DELETE /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:09:07.520848 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-21c21ef4-941c-4808-ab09-e4a176349d32 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:07.521481 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-21c21ef4-941c-4808-ab09-e4a176349d32 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] [instance: da290c35-0f36-4420-aaf8-d18fd9b906f0] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:07.527248 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-21c21ef4-941c-4808-ab09-e4a176349d32 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:07.527693 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-21c21ef4-941c-4808-ab09-e4a176349d32 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:07.528455 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-21c21ef4-941c-4808-ab09-e4a176349d32 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:07.528886 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-21c21ef4-941c-4808-ab09-e4a176349d32 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:07.542089 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-21c21ef4-941c-4808-ab09-e4a176349d32 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] HTTP exception thrown: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-21c21ef4-941c-4808-ab09-e4a176349d32 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Request method failure captured: May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 HTTP/1.1 May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ2AZq5EfNRX4A2tCiVwicbnfgrKkrL1gKGZ2i9kDkpeQEVnPD6CHxNPMLHcnk-nNrqb42O05Dml9fFcVJ8tZC-e8-FzgQMzIs0cjdHVhCDJH8lgSgXK8gUI8fFy_4mLaumbFrU7L_T2O0x7fdFRFsthOIPJ0V_6K6OxmafCQoxWJqE May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:09:07.543594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:09:07.545158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b776734a879d4c0785b1d3728b79b766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b776734a879d4c0785b1d3728b79b766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:09:07.545158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:07.545158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: b776734a879d4c0785b1d3728b79b766 May 09 23:09:07.545158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668354219 May 09 23:09:07.545158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:07.545158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:09:07.545158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:09:07.545158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 84a45506c19c4cda8173c164a097f925 May 09 23:09:07.545158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-AttachVolumeNegativeTest-1668354219-project May 09 23:09:07.545158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:09:07.545158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:09:07.545158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': 'da290c35-0f36-4420-aaf8-d18fd9b906f0'} May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:09:07.546237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. May 09 23:09:07.547650 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:07.549479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-21c21ef4-941c-4808-ab09-e4a176349d32 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] Returning 404 to user: Instance da290c35-0f36-4420-aaf8-d18fd9b906f0 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:09:07.549479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-21c21ef4-941c-4808-ab09-e4a176349d32 tempest-AttachVolumeNegativeTest-1668354219 tempest-AttachVolumeNegativeTest-1668354219-project] 10.222.0.23 "GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0" status: 404 len: 111 microversion: 2.1 time: 0.028403 May 09 23:09:07.549479 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 372/755] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:07 2022] GET /compute/v2.1/servers/da290c35-0f36-4420-aaf8-d18fd9b906f0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:09:08.429308 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2aeaf6e0-697b-446d-9f4a-281164b74a2d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:08.429913 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2aeaf6e0-697b-446d-9f4a-281164b74a2d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:08.435643 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2aeaf6e0-697b-446d-9f4a-281164b74a2d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:08.436084 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2aeaf6e0-697b-446d-9f4a-281164b74a2d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:08.436840 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2aeaf6e0-697b-446d-9f4a-281164b74a2d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:08.437269 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2aeaf6e0-697b-446d-9f4a-281164b74a2d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:08.593853 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2aeaf6e0-697b-446d-9f4a-281164b74a2d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:08.602671 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2aeaf6e0-697b-446d-9f4a-281164b74a2d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1720 microversion: 2.1 time: 0.177126 May 09 23:09:08.603411 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 384/756] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:08 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:09.620386 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1040d0d3-8e1f-45f8-9537-768d499e61c3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:09.621024 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1040d0d3-8e1f-45f8-9537-768d499e61c3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:09.628445 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1040d0d3-8e1f-45f8-9537-768d499e61c3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:09.628583 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1040d0d3-8e1f-45f8-9537-768d499e61c3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:09.629357 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1040d0d3-8e1f-45f8-9537-768d499e61c3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:09.629790 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1040d0d3-8e1f-45f8-9537-768d499e61c3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:09.791291 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1040d0d3-8e1f-45f8-9537-768d499e61c3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:09.799550 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1040d0d3-8e1f-45f8-9537-768d499e61c3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1720 microversion: 2.1 time: 0.182994 May 09 23:09:09.800116 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 373/757] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:09 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:10.822949 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-767b14af-bec9-4017-a04e-176c5d988898 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:10.823570 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-767b14af-bec9-4017-a04e-176c5d988898 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:10.831110 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-767b14af-bec9-4017-a04e-176c5d988898 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:10.831550 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-767b14af-bec9-4017-a04e-176c5d988898 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:10.832537 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-767b14af-bec9-4017-a04e-176c5d988898 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:10.832967 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-767b14af-bec9-4017-a04e-176c5d988898 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:10.964519 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-767b14af-bec9-4017-a04e-176c5d988898 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:10.972328 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-767b14af-bec9-4017-a04e-176c5d988898 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1720 microversion: 2.1 time: 0.159629 May 09 23:09:10.972898 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 385/758] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:10 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:11.988662 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-843038d3-05c5-4683-958a-ef82a5687b85 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:11.989265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-843038d3-05c5-4683-958a-ef82a5687b85 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:11.995484 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-843038d3-05c5-4683-958a-ef82a5687b85 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:11.995931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-843038d3-05c5-4683-958a-ef82a5687b85 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:11.996686 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-843038d3-05c5-4683-958a-ef82a5687b85 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:11.997115 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-843038d3-05c5-4683-958a-ef82a5687b85 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:12.128922 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-843038d3-05c5-4683-958a-ef82a5687b85 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:12.136655 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-843038d3-05c5-4683-958a-ef82a5687b85 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1720 microversion: 2.1 time: 0.151795 May 09 23:09:12.137225 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 374/759] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:11 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:12.894810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-023fe112-06d0-4227-b7a6-487c82ec1be1 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] Calling method '.version_select at 0x7fc298109940>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:12.940991 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-023fe112-06d0-4227-b7a6-487c82ec1be1 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/10e8ca67-6d8d-4dd6-bb59-78823e95dc9b" status: 200 len: 351 microversion: 2.1 time: 0.049885 May 09 23:09:12.941553 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 386/760] 10.222.0.23 () {58 vars in 1244 bytes} [Mon May 9 23:09:12 2022] GET /compute/v2.1/os-volumes/10e8ca67-6d8d-4dd6-bb59-78823e95dc9b => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:09:13.154338 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-01855edc-ddd3-4a95-9824-71b515144e9e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:13.154947 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-01855edc-ddd3-4a95-9824-71b515144e9e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:13.161629 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-01855edc-ddd3-4a95-9824-71b515144e9e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:13.162074 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-01855edc-ddd3-4a95-9824-71b515144e9e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:13.162858 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-01855edc-ddd3-4a95-9824-71b515144e9e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:13.163287 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-01855edc-ddd3-4a95-9824-71b515144e9e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:13.299147 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-01855edc-ddd3-4a95-9824-71b515144e9e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:13.307115 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-01855edc-ddd3-4a95-9824-71b515144e9e tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1720 microversion: 2.1 time: 0.156691 May 09 23:09:13.307677 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 375/761] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:13 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:14.247198 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d4d3b470-9496-4aca-a578-76433aa8ef28 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] Calling method '.version_select at 0x7fc298116310>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:14.292186 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d4d3b470-9496-4aca-a578-76433aa8ef28 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d1476979-475e-413c-aa8c-fe03c09fdf5f" status: 200 len: 350 microversion: 2.1 time: 0.049127 May 09 23:09:14.292746 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 387/762] 10.222.0.23 () {58 vars in 1244 bytes} [Mon May 9 23:09:14 2022] GET /compute/v2.1/os-volumes/d1476979-475e-413c-aa8c-fe03c09fdf5f => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:09:14.324399 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-132703df-bcc5-41b0-9226-b0f6af6728cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:14.325017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-132703df-bcc5-41b0-9226-b0f6af6728cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:14.332303 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-132703df-bcc5-41b0-9226-b0f6af6728cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:14.332762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-132703df-bcc5-41b0-9226-b0f6af6728cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:14.333730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-132703df-bcc5-41b0-9226-b0f6af6728cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:14.337898 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-132703df-bcc5-41b0-9226-b0f6af6728cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:14.487936 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-132703df-bcc5-41b0-9226-b0f6af6728cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:14.497232 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-132703df-bcc5-41b0-9226-b0f6af6728cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1720 microversion: 2.1 time: 0.176580 May 09 23:09:14.498166 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 376/763] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:14 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:15.515775 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e0f573fa-a55c-4480-803d-9c570a7cc324 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:15.516383 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e0f573fa-a55c-4480-803d-9c570a7cc324 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:15.522860 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e0f573fa-a55c-4480-803d-9c570a7cc324 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:15.523309 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e0f573fa-a55c-4480-803d-9c570a7cc324 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:15.524066 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e0f573fa-a55c-4480-803d-9c570a7cc324 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:15.524495 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e0f573fa-a55c-4480-803d-9c570a7cc324 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:15.633451 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-04e129d0-9a4c-4145-acfc-d52bae427482 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] Calling method '.version_select at 0x7fc28ba325e0>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:15.651983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e0f573fa-a55c-4480-803d-9c570a7cc324 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:15.659675 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e0f573fa-a55c-4480-803d-9c570a7cc324 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1697 microversion: 2.1 time: 0.148735 May 09 23:09:15.660251 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 388/764] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:15 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1697 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:09:15.676223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5873eb3d-9cb0-46a5-8067-87dafad67dd0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:09:15.681151 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-04e129d0-9a4c-4145-acfc-d52bae427482 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/913c791a-83d0-4f19-8363-47ecfec249e8" status: 200 len: 350 microversion: 2.1 time: 0.051403 May 09 23:09:15.681805 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 377/765] 10.222.0.23 () {58 vars in 1244 bytes} [Mon May 9 23:09:15 2022] GET /compute/v2.1/os-volumes/913c791a-83d0-4f19-8363-47ecfec249e8 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:09:15.682379 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5873eb3d-9cb0-46a5-8067-87dafad67dd0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:15.682891 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5873eb3d-9cb0-46a5-8067-87dafad67dd0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:15.693028 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c4284359-de4c-42f6-8a8f-705b0945efc4 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] Calling method '.version_select at 0x7fc28ba3e280>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:15.705716 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-5873eb3d-9cb0-46a5-8067-87dafad67dd0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Going to try to start instance {{(pid=117143) start /opt/stack/nova/nova/compute/api.py:2730}} May 09 23:09:15.747675 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-5873eb3d-9cb0-46a5-8067-87dafad67dd0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "POST /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/action" status: 202 len: 0 microversion: 2.1 time: 0.075319 May 09 23:09:15.748276 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 389/766] 10.222.0.23 () {60 vars in 1277 bytes} [Mon May 9 23:09:15 2022] POST /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 23:09:15.757061 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-bd7ec9c4-18b9-4a61-840e-0c7130e50f05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:15.757753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-bd7ec9c4-18b9-4a61-840e-0c7130e50f05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:15.764612 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bd7ec9c4-18b9-4a61-840e-0c7130e50f05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:15.765064 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bd7ec9c4-18b9-4a61-840e-0c7130e50f05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:15.765831 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bd7ec9c4-18b9-4a61-840e-0c7130e50f05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:15.766312 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bd7ec9c4-18b9-4a61-840e-0c7130e50f05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:15.775454 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c4284359-de4c-42f6-8a8f-705b0945efc4 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085934 May 09 23:09:15.785036 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 378/767] 10.222.0.23 () {58 vars in 1133 bytes} [Mon May 9 23:09:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:09:15.789906 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-533740c3-4d88-4cc1-9c0b-615c2666350c tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] Calling method '.version_select at 0x7fc28b9dc4c0>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:15.879264 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-533740c3-4d88-4cc1-9c0b-615c2666350c tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.092919 May 09 23:09:15.879845 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 379/768] 10.222.0.23 () {58 vars in 1148 bytes} [Mon May 9 23:09:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:09:15.891021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-87cbc009-f0f0-4f39-b93f-a9e03d776817 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] Calling method '.version_select at 0x7fc28b9dcaf0>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:15.947092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-bd7ec9c4-18b9-4a61-840e-0c7130e50f05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:15.956035 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-bd7ec9c4-18b9-4a61-840e-0c7130e50f05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1706 microversion: 2.1 time: 0.202798 May 09 23:09:15.956695 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 390/769] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:15 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1706 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:09:15.969951 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-87cbc009-f0f0-4f39-b93f-a9e03d776817 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082319 May 09 23:09:15.977041 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 380/770] 10.222.0.23 () {58 vars in 1133 bytes} [Mon May 9 23:09:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:09:15.982258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c023ac50-6f75-4774-af07-09ff79e8a246 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] Calling method '.version_select at 0x7fc298109280>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:16.063352 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c023ac50-6f75-4774-af07-09ff79e8a246 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084994 May 09 23:09:16.063922 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 391/771] 10.222.0.23 () {58 vars in 1166 bytes} [Mon May 9 23:09:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:09:16.075216 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c2ade22c-c407-4dc3-adb7-3d0e941a327f tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] Calling method '.version_select at 0x7fc28ba3e160>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:16.153621 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c2ade22c-c407-4dc3-adb7-3d0e941a327f tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.082034 May 09 23:09:16.154233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 381/772] 10.222.0.23 () {58 vars in 1169 bytes} [Mon May 9 23:09:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:09:16.166807 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6271cbc3-5513-4a37-8e2b-a66f31b44add tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] Calling method '.version_select at 0x7fc2981163a0>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:16.245707 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6271cbc3-5513-4a37-8e2b-a66f31b44add tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.082699 May 09 23:09:16.246313 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 392/773] 10.222.0.23 () {58 vars in 1154 bytes} [Mon May 9 23:09:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:16.257222 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c2e90a65-3666-4a92-a8e3-8573fc323d77 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] Calling method '.version_select at 0x7fc28ba321f0>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:16.340867 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c2e90a65-3666-4a92-a8e3-8573fc323d77 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087260 May 09 23:09:16.341451 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 382/774] 10.222.0.23 () {58 vars in 1187 bytes} [Mon May 9 23:09:16 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:09:16.352743 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-9bd67f05-da9a-4993-b771-48af5a646906 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] Calling method '.version_select at 0x7fc2981284c0>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:16.433452 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-9bd67f05-da9a-4993-b771-48af5a646906 tempest-VolumesTestJSON-253228544 tempest-VolumesTestJSON-253228544-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084369 May 09 23:09:16.434026 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 393/775] 10.222.0.23 () {58 vars in 1154 bytes} [Mon May 9 23:09:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:16.973683 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-b9b1fe7a-92f1-4f7b-b0aa-0108bded50bb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:16.974364 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-b9b1fe7a-92f1-4f7b-b0aa-0108bded50bb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:16.980305 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b9b1fe7a-92f1-4f7b-b0aa-0108bded50bb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:16.980759 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b9b1fe7a-92f1-4f7b-b0aa-0108bded50bb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:16.981781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b9b1fe7a-92f1-4f7b-b0aa-0108bded50bb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:16.982249 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b9b1fe7a-92f1-4f7b-b0aa-0108bded50bb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:17.106375 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-b9b1fe7a-92f1-4f7b-b0aa-0108bded50bb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:17.114711 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-b9b1fe7a-92f1-4f7b-b0aa-0108bded50bb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1706 microversion: 2.1 time: 0.145800 May 09 23:09:17.115283 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 383/776] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:16 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1706 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:18.132404 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-be7f4442-a784-41d0-9fc4-12c33f205160 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:18.132974 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-be7f4442-a784-41d0-9fc4-12c33f205160 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:18.139032 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-be7f4442-a784-41d0-9fc4-12c33f205160 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:18.139486 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-be7f4442-a784-41d0-9fc4-12c33f205160 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:18.140249 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-be7f4442-a784-41d0-9fc4-12c33f205160 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:18.140686 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-be7f4442-a784-41d0-9fc4-12c33f205160 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:18.265001 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-be7f4442-a784-41d0-9fc4-12c33f205160 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:18.273797 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-be7f4442-a784-41d0-9fc4-12c33f205160 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1710 microversion: 2.1 time: 0.145672 May 09 23:09:18.274415 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 394/777] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:09:18 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1710 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:25.332654 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-be99ee87-3e91-4b4e-91a4-d895659dff54 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:25.333679 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-be99ee87-3e91-4b4e-91a4-d895659dff54 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:25.339945 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-be99ee87-3e91-4b4e-91a4-d895659dff54 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:25.340467 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-be99ee87-3e91-4b4e-91a4-d895659dff54 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:25.341309 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-be99ee87-3e91-4b4e-91a4-d895659dff54 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:25.341755 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-be99ee87-3e91-4b4e-91a4-d895659dff54 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:25.370619 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-be99ee87-3e91-4b4e-91a4-d895659dff54 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042370 May 09 23:09:25.371184 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 384/778] 10.222.0.23 () {60 vars in 1342 bytes} [Mon May 9 23:09:25 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:09:25.432244 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1edac22b-b4b3-4a6a-a481-f0456e0d1654 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:25.432937 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1edac22b-b4b3-4a6a-a481-f0456e0d1654 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:25.439519 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1edac22b-b4b3-4a6a-a481-f0456e0d1654 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:25.439965 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1edac22b-b4b3-4a6a-a481-f0456e0d1654 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:25.440731 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1edac22b-b4b3-4a6a-a481-f0456e0d1654 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:25.441188 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1edac22b-b4b3-4a6a-a481-f0456e0d1654 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:25.465921 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1edac22b-b4b3-4a6a-a481-f0456e0d1654 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Going to try to terminate instance {{(pid=117143) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:09:25.546430 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1edac22b-b4b3-4a6a-a481-f0456e0d1654 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 204 len: 0 microversion: 2.20 time: 0.118120 May 09 23:09:25.547061 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 395/779] 10.222.0.23 () {60 vars in 1279 bytes} [Mon May 9 23:09:25 2022] DELETE /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 23:09:25.555589 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-6e094377-bf77-4639-a3cf-7a84b84d92cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:25.556340 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-6e094377-bf77-4639-a3cf-7a84b84d92cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:25.562918 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6e094377-bf77-4639-a3cf-7a84b84d92cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:25.563437 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6e094377-bf77-4639-a3cf-7a84b84d92cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:25.564228 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6e094377-bf77-4639-a3cf-7a84b84d92cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:25.564700 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6e094377-bf77-4639-a3cf-7a84b84d92cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:25.713183 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-6e094377-bf77-4639-a3cf-7a84b84d92cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:25.721335 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-6e094377-bf77-4639-a3cf-7a84b84d92cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:25.723451 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-6e094377-bf77-4639-a3cf-7a84b84d92cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:25.724608 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-6e094377-bf77-4639-a3cf-7a84b84d92cb tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.173072 May 09 23:09:25.725179 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 385/780] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:09:25 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:09:26.743762 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-8aef451a-db01-4661-8367-3ef483e38598 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:26.744538 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-8aef451a-db01-4661-8367-3ef483e38598 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:26.751183 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8aef451a-db01-4661-8367-3ef483e38598 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:26.751636 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8aef451a-db01-4661-8367-3ef483e38598 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:26.752403 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8aef451a-db01-4661-8367-3ef483e38598 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:26.752833 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8aef451a-db01-4661-8367-3ef483e38598 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:26.898770 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-8aef451a-db01-4661-8367-3ef483e38598 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:26.908070 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-8aef451a-db01-4661-8367-3ef483e38598 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:26.910427 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-8aef451a-db01-4661-8367-3ef483e38598 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:26.911977 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-8aef451a-db01-4661-8367-3ef483e38598 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1723 microversion: 2.20 time: 0.172337 May 09 23:09:26.912807 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 396/781] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:09:26 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 23:09:27.931003 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c28f81d6-0560-4c68-b407-17c8b7ac94f2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:27.931775 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c28f81d6-0560-4c68-b407-17c8b7ac94f2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:27.938511 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c28f81d6-0560-4c68-b407-17c8b7ac94f2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:27.938962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c28f81d6-0560-4c68-b407-17c8b7ac94f2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:27.939741 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c28f81d6-0560-4c68-b407-17c8b7ac94f2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:27.940273 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c28f81d6-0560-4c68-b407-17c8b7ac94f2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:28.003366 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c28f81d6-0560-4c68-b407-17c8b7ac94f2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:28.016989 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c28f81d6-0560-4c68-b407-17c8b7ac94f2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:28.018710 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c28f81d6-0560-4c68-b407-17c8b7ac94f2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950754974d748519118d974492f15ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38af4b388e49958aa17250c181b203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:09:28.019932 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c28f81d6-0560-4c68-b407-17c8b7ac94f2 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 200 len: 1656 microversion: 2.20 time: 0.092779 May 09 23:09:28.020688 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 386/782] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:09:27 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 1656 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 23:09:28.070586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-30befe81-63c4-46bb-a912-fcf3ce224cff req-a04656bf-0f79-406b-b15c-cf8ad1edb073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cdc1269-4f55-47ba-8ebc-a403362e1962", "name": "network-vif-deleted", "tag": "a898f67f-017d-433f-9c0f-e6793182e363"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:09:28.078998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-30befe81-63c4-46bb-a912-fcf3ce224cff req-a04656bf-0f79-406b-b15c-cf8ad1edb073 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:28.079491 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-30befe81-63c4-46bb-a912-fcf3ce224cff req-a04656bf-0f79-406b-b15c-cf8ad1edb073 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:28.093110 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-30befe81-63c4-46bb-a912-fcf3ce224cff req-a04656bf-0f79-406b-b15c-cf8ad1edb073 service nova] Creating event network-vif-deleted:a898f67f-017d-433f-9c0f-e6793182e363 for instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 on hv-cinder-84067 May 09 23:09:28.099059 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-30befe81-63c4-46bb-a912-fcf3ce224cff req-a04656bf-0f79-406b-b15c-cf8ad1edb073 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032029 May 09 23:09:28.099681 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 397/783] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:09:29.038473 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c6696bf9-ed88-4300-85be-10cfdf1e9a23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:29.039190 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c6696bf9-ed88-4300-85be-10cfdf1e9a23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:29.045652 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c6696bf9-ed88-4300-85be-10cfdf1e9a23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:29.046107 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c6696bf9-ed88-4300-85be-10cfdf1e9a23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:29.046956 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c6696bf9-ed88-4300-85be-10cfdf1e9a23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:29.047389 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c6696bf9-ed88-4300-85be-10cfdf1e9a23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:29.061487 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-c6696bf9-ed88-4300-85be-10cfdf1e9a23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] HTTP exception thrown: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c6696bf9-ed88-4300-85be-10cfdf1e9a23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Request method failure captured: May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 HTTP/1.1 May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ3QSZIIwAQl8gt77Y_FqFeGc70vpcHEVvAEzfY76g2s1KHzoep_X28Anb8N4KwEGcWkOPHZLR3inQgWrQ1PchRQks70K9fr8apUDLJoRSZrBXunCwCdhEDMFqssiBL72_qeOpkUOV7Mimkf-GO7YOoyKXPh-MRwaKBfvBYTGpEn4hY May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Openstack-Nova-Api-Version: 2.20 May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: 0f38af4b388e49958aa17250c181b203 May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:09:29.063304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:09:29.065017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0f38af4b388e49958aa17250c181b203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0f38af4b388e49958aa17250c181b203"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f38af4b388e49958aa17250c181b203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f38af4b388e49958aa17250c181b203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:09:29.065017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:29.065017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: 0f38af4b388e49958aa17250c181b203 May 09 23:09:29.065017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:29.065017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-AttachVolumeShelveTestJSON-1248822270-project May 09 23:09:29.065017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:09:29.065017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:09:29.065017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: c950754974d748519118d974492f15ce May 09 23:09:29.065017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1248822270-project May 09 23:09:29.065017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:09:29.065017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:29.065017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '0cdc1269-4f55-47ba-8ebc-a403362e1962'} May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:09:29.065935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:29.067538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:29.069537 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c6696bf9-ed88-4300-85be-10cfdf1e9a23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Returning 404 to user: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:09:29.070358 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c6696bf9-ed88-4300-85be-10cfdf1e9a23 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 404 len: 111 microversion: 2.20 time: 0.036384 May 09 23:09:29.070913 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 387/784] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:09:29 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 23:09:29.082584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c538440b-cf68-49ba-9f09-f77b06af6503 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '.version_select at 0x7fc2980f50d0>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:29.107967 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c538440b-cf68-49ba-9f09-f77b06af6503 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-104094240" status: 204 len: 0 microversion: 2.20 time: 0.032279 May 09 23:09:29.108640 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 398/785] 10.222.0.23 () {60 vars in 1258 bytes} [Mon May 9 23:09:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-104094240 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 09 23:09:30.871042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-7fbaa0d4-05d7-4c57-b101-bb69e2f28bed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:30.871545 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-7fbaa0d4-05d7-4c57-b101-bb69e2f28bed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:30.878305 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7fbaa0d4-05d7-4c57-b101-bb69e2f28bed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:30.878805 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7fbaa0d4-05d7-4c57-b101-bb69e2f28bed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:30.879586 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7fbaa0d4-05d7-4c57-b101-bb69e2f28bed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:30.880197 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7fbaa0d4-05d7-4c57-b101-bb69e2f28bed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:30.894530 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-7fbaa0d4-05d7-4c57-b101-bb69e2f28bed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] HTTP exception thrown: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-7fbaa0d4-05d7-4c57-b101-bb69e2f28bed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Request method failure captured: May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: DELETE /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 HTTP/1.1 May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ3QSZIIwAQl8gt77Y_FqFeGc70vpcHEVvAEzfY76g2s1KHzoep_X28Anb8N4KwEGcWkOPHZLR3inQgWrQ1PchRQks70K9fr8apUDLJoRSZrBXunCwCdhEDMFqssiBL72_qeOpkUOV7Mimkf-GO7YOoyKXPh-MRwaKBfvBYTGpEn4hY May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Openstack-Nova-Api-Version: 2.20 May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: 0f38af4b388e49958aa17250c181b203 May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:09:30.896127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:09:30.897762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0f38af4b388e49958aa17250c181b203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0f38af4b388e49958aa17250c181b203"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f38af4b388e49958aa17250c181b203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f38af4b388e49958aa17250c181b203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:09:30.897762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:30.897762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: 0f38af4b388e49958aa17250c181b203 May 09 23:09:30.897762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:30.897762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-AttachVolumeShelveTestJSON-1248822270-project May 09 23:09:30.897762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:09:30.897762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:09:30.897762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: c950754974d748519118d974492f15ce May 09 23:09:30.897762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1248822270-project May 09 23:09:30.897762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:09:30.897762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:30.897762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '0cdc1269-4f55-47ba-8ebc-a403362e1962'} May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:09:30.899059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:30.900860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:30.903012 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-7fbaa0d4-05d7-4c57-b101-bb69e2f28bed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Returning 404 to user: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:09:30.903862 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-7fbaa0d4-05d7-4c57-b101-bb69e2f28bed tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 404 len: 111 microversion: 2.20 time: 0.036684 May 09 23:09:30.904432 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 388/786] 10.222.0.23 () {60 vars in 1279 bytes} [Mon May 9 23:09:30 2022] DELETE /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 23:09:30.913620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b4d6de83-5724-4cb9-a9c9-b49361d89cf0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:30.914456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b4d6de83-5724-4cb9-a9c9-b49361d89cf0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 0cdc1269-4f55-47ba-8ebc-a403362e1962] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:30.921187 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b4d6de83-5724-4cb9-a9c9-b49361d89cf0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:30.921721 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b4d6de83-5724-4cb9-a9c9-b49361d89cf0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:30.922596 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b4d6de83-5724-4cb9-a9c9-b49361d89cf0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:30.923125 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b4d6de83-5724-4cb9-a9c9-b49361d89cf0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:30.936502 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-b4d6de83-5724-4cb9-a9c9-b49361d89cf0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] HTTP exception thrown: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b4d6de83-5724-4cb9-a9c9-b49361d89cf0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Request method failure captured: May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 HTTP/1.1 May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ3QSZIIwAQl8gt77Y_FqFeGc70vpcHEVvAEzfY76g2s1KHzoep_X28Anb8N4KwEGcWkOPHZLR3inQgWrQ1PchRQks70K9fr8apUDLJoRSZrBXunCwCdhEDMFqssiBL72_qeOpkUOV7Mimkf-GO7YOoyKXPh-MRwaKBfvBYTGpEn4hY May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Openstack-Nova-Api-Version: 2.20 May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 0f38af4b388e49958aa17250c181b203 May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:09:30.938149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:09:30.939520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0f38af4b388e49958aa17250c181b203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0f38af4b388e49958aa17250c181b203"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f38af4b388e49958aa17250c181b203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f38af4b388e49958aa17250c181b203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:09:30.939520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:30.939520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 0f38af4b388e49958aa17250c181b203 May 09 23:09:30.939520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:30.939520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-AttachVolumeShelveTestJSON-1248822270-project May 09 23:09:30.939520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:09:30.939520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:09:30.939520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: c950754974d748519118d974492f15ce May 09 23:09:30.939520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1248822270-project May 09 23:09:30.939520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:09:30.939520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:30.939520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': '0cdc1269-4f55-47ba-8ebc-a403362e1962'} May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:09:30.940286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. May 09 23:09:30.941478 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:30.942565 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b4d6de83-5724-4cb9-a9c9-b49361d89cf0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Returning 404 to user: Instance 0cdc1269-4f55-47ba-8ebc-a403362e1962 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:09:30.942565 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b4d6de83-5724-4cb9-a9c9-b49361d89cf0 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962" status: 404 len: 111 microversion: 2.20 time: 0.030916 May 09 23:09:30.942565 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 399/787] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:09:30 2022] GET /compute/v2.1/servers/0cdc1269-4f55-47ba-8ebc-a403362e1962 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 23:09:32.080343 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5eb0f578-4251-480d-846d-2d177997701f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:32.081381 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5eb0f578-4251-480d-846d-2d177997701f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:32.087634 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5eb0f578-4251-480d-846d-2d177997701f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:32.088090 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5eb0f578-4251-480d-846d-2d177997701f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:32.088860 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5eb0f578-4251-480d-846d-2d177997701f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:32.089296 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5eb0f578-4251-480d-846d-2d177997701f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:32.102844 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-5eb0f578-4251-480d-846d-2d177997701f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] HTTP exception thrown: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5eb0f578-4251-480d-846d-2d177997701f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Request method failure captured: May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: DELETE /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a HTTP/1.1 May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ3QSZIIwAQl8gt77Y_FqFeGc70vpcHEVvAEzfY76g2s1KHzoep_X28Anb8N4KwEGcWkOPHZLR3inQgWrQ1PchRQks70K9fr8apUDLJoRSZrBXunCwCdhEDMFqssiBL72_qeOpkUOV7Mimkf-GO7YOoyKXPh-MRwaKBfvBYTGpEn4hY May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Openstack-Nova-Api-Version: 2.20 May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: 0f38af4b388e49958aa17250c181b203 May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:09:32.104411 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:09:32.106325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0f38af4b388e49958aa17250c181b203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0f38af4b388e49958aa17250c181b203"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f38af4b388e49958aa17250c181b203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f38af4b388e49958aa17250c181b203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:09:32.106325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:32.106325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: 0f38af4b388e49958aa17250c181b203 May 09 23:09:32.106325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:32.106325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-AttachVolumeShelveTestJSON-1248822270-project May 09 23:09:32.106325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:09:32.106325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:09:32.106325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: c950754974d748519118d974492f15ce May 09 23:09:32.106325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1248822270-project May 09 23:09:32.106325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:09:32.106325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:09:32.106325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '2e5734d5-da65-4ee8-8684-e236f56da50a'} May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:09:32.107262 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:09:32.108764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:09:32.110281 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5eb0f578-4251-480d-846d-2d177997701f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Returning 404 to user: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:09:32.110281 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5eb0f578-4251-480d-846d-2d177997701f tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 404 len: 111 microversion: 2.20 time: 0.029499 May 09 23:09:32.110281 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 389/788] 10.222.0.23 () {60 vars in 1279 bytes} [Mon May 9 23:09:32 2022] DELETE /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 23:09:32.115250 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-80c5515e-db07-47bd-81d9-a18dc3601ba8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:32.115863 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-80c5515e-db07-47bd-81d9-a18dc3601ba8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] [instance: 2e5734d5-da65-4ee8-8684-e236f56da50a] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:32.122034 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-80c5515e-db07-47bd-81d9-a18dc3601ba8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:32.122523 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-80c5515e-db07-47bd-81d9-a18dc3601ba8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:32.123300 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-80c5515e-db07-47bd-81d9-a18dc3601ba8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:32.123733 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-80c5515e-db07-47bd-81d9-a18dc3601ba8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:32.137178 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-80c5515e-db07-47bd-81d9-a18dc3601ba8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] HTTP exception thrown: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-80c5515e-db07-47bd-81d9-a18dc3601ba8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Request method failure captured: May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a HTTP/1.1 May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ3QSZIIwAQl8gt77Y_FqFeGc70vpcHEVvAEzfY76g2s1KHzoep_X28Anb8N4KwEGcWkOPHZLR3inQgWrQ1PchRQks70K9fr8apUDLJoRSZrBXunCwCdhEDMFqssiBL72_qeOpkUOV7Mimkf-GO7YOoyKXPh-MRwaKBfvBYTGpEn4hY May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Openstack-Nova-Api-Version: 2.20 May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 0f38af4b388e49958aa17250c181b203 May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:09:32.138760 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:09:32.140447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0f38af4b388e49958aa17250c181b203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0f38af4b388e49958aa17250c181b203"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f38af4b388e49958aa17250c181b203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0f38af4b388e49958aa17250c181b203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:09:32.140447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:32.140447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 0f38af4b388e49958aa17250c181b203 May 09 23:09:32.140447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1248822270 May 09 23:09:32.140447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-AttachVolumeShelveTestJSON-1248822270-project May 09 23:09:32.140447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:09:32.140447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:09:32.140447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: c950754974d748519118d974492f15ce May 09 23:09:32.140447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1248822270-project May 09 23:09:32.140447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:09:32.140447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:09:32.140447 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': '2e5734d5-da65-4ee8-8684-e236f56da50a'} May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:09:32.141472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. May 09 23:09:32.143147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:09:32.144768 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-80c5515e-db07-47bd-81d9-a18dc3601ba8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] Returning 404 to user: Instance 2e5734d5-da65-4ee8-8684-e236f56da50a could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:09:32.144768 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-80c5515e-db07-47bd-81d9-a18dc3601ba8 tempest-AttachVolumeShelveTestJSON-1248822270 tempest-AttachVolumeShelveTestJSON-1248822270-project] 10.222.0.23 "GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a" status: 404 len: 111 microversion: 2.20 time: 0.029167 May 09 23:09:32.144768 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 400/789] 10.222.0.23 () {60 vars in 1276 bytes} [Mon May 9 23:09:32 2022] GET /compute/v2.1/servers/2e5734d5-da65-4ee8-8684-e236f56da50a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 23:09:58.402350 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-8790a496-3503-4a38-9db7-23499c0f23d5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:09:58.402926 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-8790a496-3503-4a38-9db7-23499c0f23d5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:09:58.408745 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8790a496-3503-4a38-9db7-23499c0f23d5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:58.409195 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8790a496-3503-4a38-9db7-23499c0f23d5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:58.409969 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8790a496-3503-4a38-9db7-23499c0f23d5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:09:58.410429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8790a496-3503-4a38-9db7-23499c0f23d5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:09:58.490547 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-8790a496-3503-4a38-9db7-23499c0f23d5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lazy-loading 'services' on Instance uuid 7e8552f4-9cab-423d-ae4f-6790f5de0f91 {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:09:58.579049 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-8790a496-3503-4a38-9db7-23499c0f23d5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/os-volume_attachments/a645f0a7-0207-4f9a-9e9d-6026d7271561" status: 202 len: 0 microversion: 2.1 time: 0.180914 May 09 23:09:58.580161 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 390/790] 10.222.0.23 () {58 vars in 1415 bytes} [Mon May 9 23:09:58 2022] DELETE /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/os-volume_attachments/a645f0a7-0207-4f9a-9e9d-6026d7271561 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:10:05.635407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-810523946", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "networks": [{"uuid": "dd59166f-fc33-4aba-ba9d-e309f5309b64"}]}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:10:05.687281 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.network.neutron [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] validate_networks() for [('dd59166f-fc33-4aba-ba9d-e309f5309b64', None, None, None, None, None)] {{(pid=117143) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:10:06.020585 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Flavor limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:10:06.021005 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Image limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:10:06.021473 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Flavor pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:10:06.021878 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Image pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:10:06.022338 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:10:06.031329 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:06.031774 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:06.032574 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:06.033007 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:06.044943 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9f588b9a-5ac0-47e2-9715-a48c4fa72315 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:10:06.049912 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Getting quotas for project f99e7d13264c4801bbd78669d85fd6ce. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:10:06.051306 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9f588b9a-5ac0-47e2-9715-a48c4fa72315 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:06.051827 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9f588b9a-5ac0-47e2-9715-a48c4fa72315 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:06.053749 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Getting quotas for user 8f0d8c487e3a4570abea4ad26bcaa34a and project f99e7d13264c4801bbd78669d85fd6ce. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:10:06.064289 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Going to run 1 instances... {{(pid=117143) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:10:06.066490 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:10:06.112465 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-663c6e7a-662a-43cd-b41e-e99d5ede70aa tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.481649 May 09 23:10:06.113278 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 401/791] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:10:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:10:06.113524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9f588b9a-5ac0-47e2-9715-a48c4fa72315 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Going to try to stop instance {{(pid=117142) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 09 23:10:06.122978 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-3a91efc2-49b2-4676-931f-73f1005433ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:06.123711 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-3a91efc2-49b2-4676-931f-73f1005433ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:06.164127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9f588b9a-5ac0-47e2-9715-a48c4fa72315 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "POST /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/action" status: 202 len: 0 microversion: 2.1 time: 0.124330 May 09 23:10:06.165041 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 391/792] 10.222.0.23 () {60 vars in 1277 bytes} [Mon May 9 23:10:06 2022] POST /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:10:06.174624 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5870c507-06ac-4c4b-9296-a224c3d95d0c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:06.175609 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5870c507-06ac-4c4b-9296-a224c3d95d0c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:06.183284 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5870c507-06ac-4c4b-9296-a224c3d95d0c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:06.183930 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3a91efc2-49b2-4676-931f-73f1005433ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:06.184138 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5870c507-06ac-4c4b-9296-a224c3d95d0c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:06.184918 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5870c507-06ac-4c4b-9296-a224c3d95d0c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:06.185356 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5870c507-06ac-4c4b-9296-a224c3d95d0c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:06.194535 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-3a91efc2-49b2-4676-931f-73f1005433ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 200 len: 1213 microversion: 2.1 time: 0.075187 May 09 23:10:06.195295 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 402/793] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:06 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:10:06.317300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5870c507-06ac-4c4b-9296-a224c3d95d0c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:06.325492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5870c507-06ac-4c4b-9296-a224c3d95d0c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1674 microversion: 2.1 time: 0.155492 May 09 23:10:06.326066 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 392/794] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:06 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:10:07.211344 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b9a9767a-45e4-4ffe-834f-49b7e85f017a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:07.212219 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b9a9767a-45e4-4ffe-834f-49b7e85f017a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:07.219636 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b9a9767a-45e4-4ffe-834f-49b7e85f017a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:07.220319 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b9a9767a-45e4-4ffe-834f-49b7e85f017a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:07.221105 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b9a9767a-45e4-4ffe-834f-49b7e85f017a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:07.221545 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b9a9767a-45e4-4ffe-834f-49b7e85f017a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:07.290213 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b9a9767a-45e4-4ffe-834f-49b7e85f017a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:07.297996 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b9a9767a-45e4-4ffe-834f-49b7e85f017a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 200 len: 1271 microversion: 2.1 time: 0.090574 May 09 23:10:07.298607 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 403/795] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:07 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:07.344038 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-03a4b3b3-26bf-4bc5-95ad-6befd139a9b7 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:07.344658 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-03a4b3b3-26bf-4bc5-95ad-6befd139a9b7 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:07.351097 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-03a4b3b3-26bf-4bc5-95ad-6befd139a9b7 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:07.351587 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-03a4b3b3-26bf-4bc5-95ad-6befd139a9b7 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:07.352390 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-03a4b3b3-26bf-4bc5-95ad-6befd139a9b7 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:07.352871 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-03a4b3b3-26bf-4bc5-95ad-6befd139a9b7 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:07.485616 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-03a4b3b3-26bf-4bc5-95ad-6befd139a9b7 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:07.495013 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-03a4b3b3-26bf-4bc5-95ad-6befd139a9b7 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1674 microversion: 2.1 time: 0.154850 May 09 23:10:07.495698 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 393/796] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:07 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:08.315874 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-060509c6-2aae-4b9d-94cb-b99696c448db tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:08.316484 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-060509c6-2aae-4b9d-94cb-b99696c448db tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:08.323360 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-060509c6-2aae-4b9d-94cb-b99696c448db tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:08.323809 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-060509c6-2aae-4b9d-94cb-b99696c448db tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:08.324588 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-060509c6-2aae-4b9d-94cb-b99696c448db tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:08.325020 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-060509c6-2aae-4b9d-94cb-b99696c448db tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:08.477487 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-377afdcc-fff7-4dd3-8412-23707d682db0 req-a354f9a5-007f-4035-a860-2f4ad4d3ee96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd1bf588-de21-4f1e-ae63-9b304a0c9cb5", "tag": "f7f7e28a-dd0e-413a-aac6-da9fc10fde66"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:10:08.490049 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-377afdcc-fff7-4dd3-8412-23707d682db0 req-a354f9a5-007f-4035-a860-2f4ad4d3ee96 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:08.490524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-377afdcc-fff7-4dd3-8412-23707d682db0 req-a354f9a5-007f-4035-a860-2f4ad4d3ee96 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:08.502516 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-377afdcc-fff7-4dd3-8412-23707d682db0 req-a354f9a5-007f-4035-a860-2f4ad4d3ee96 service nova] Creating event network-changed:f7f7e28a-dd0e-413a-aac6-da9fc10fde66 for instance fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 on hv-cinder-84067 May 09 23:10:08.507550 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-377afdcc-fff7-4dd3-8412-23707d682db0 req-a354f9a5-007f-4035-a860-2f4ad4d3ee96 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033609 May 09 23:10:08.508153 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 394/797] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:10:08.513772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0987e0b3-f434-4db9-adad-df5fdc59ffeb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:08.514485 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-0987e0b3-f434-4db9-adad-df5fdc59ffeb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:08.521476 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0987e0b3-f434-4db9-adad-df5fdc59ffeb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:08.521922 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0987e0b3-f434-4db9-adad-df5fdc59ffeb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:08.522733 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0987e0b3-f434-4db9-adad-df5fdc59ffeb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:08.523163 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0987e0b3-f434-4db9-adad-df5fdc59ffeb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:08.532690 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-060509c6-2aae-4b9d-94cb-b99696c448db tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:08.543330 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-060509c6-2aae-4b9d-94cb-b99696c448db tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 200 len: 1313 microversion: 2.1 time: 0.231214 May 09 23:10:08.544493 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 404/798] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:08 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:08.654400 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-0987e0b3-f434-4db9-adad-df5fdc59ffeb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:08.661770 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0987e0b3-f434-4db9-adad-df5fdc59ffeb tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1674 microversion: 2.1 time: 0.152343 May 09 23:10:08.662443 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 395/799] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:08 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:09.560156 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-fd1e386f-8735-475b-b1b2-4161a812eef7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:09.560772 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-fd1e386f-8735-475b-b1b2-4161a812eef7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:09.567069 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fd1e386f-8735-475b-b1b2-4161a812eef7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:09.567513 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fd1e386f-8735-475b-b1b2-4161a812eef7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:09.568276 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fd1e386f-8735-475b-b1b2-4161a812eef7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:09.568703 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fd1e386f-8735-475b-b1b2-4161a812eef7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:09.678973 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d74d3594-8d16-4740-bb52-3ed2770a7e42 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:09.679656 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-d74d3594-8d16-4740-bb52-3ed2770a7e42 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:09.686622 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d74d3594-8d16-4740-bb52-3ed2770a7e42 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:09.687074 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d74d3594-8d16-4740-bb52-3ed2770a7e42 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:09.688714 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d74d3594-8d16-4740-bb52-3ed2770a7e42 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:09.689504 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d74d3594-8d16-4740-bb52-3ed2770a7e42 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:09.702795 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-fd1e386f-8735-475b-b1b2-4161a812eef7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:09.710218 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-fd1e386f-8735-475b-b1b2-4161a812eef7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 200 len: 1313 microversion: 2.1 time: 0.154286 May 09 23:10:09.711097 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 405/800] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:09 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:09.820103 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-d74d3594-8d16-4740-bb52-3ed2770a7e42 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:09.828577 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d74d3594-8d16-4740-bb52-3ed2770a7e42 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1674 microversion: 2.1 time: 0.153451 May 09 23:10:09.829167 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 396/801] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:09 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:10:10.725884 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f4b50f38-1eaf-449a-b6bf-9fce90da6c1d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:10.726463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f4b50f38-1eaf-449a-b6bf-9fce90da6c1d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:10.733006 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f4b50f38-1eaf-449a-b6bf-9fce90da6c1d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:10.733456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f4b50f38-1eaf-449a-b6bf-9fce90da6c1d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:10.734258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f4b50f38-1eaf-449a-b6bf-9fce90da6c1d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:10.734699 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f4b50f38-1eaf-449a-b6bf-9fce90da6c1d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:10.846663 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cb11627e-7cde-47ee-b77e-b1a43eb22d80 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:10.847261 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cb11627e-7cde-47ee-b77e-b1a43eb22d80 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:10.855087 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cb11627e-7cde-47ee-b77e-b1a43eb22d80 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:10.855544 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cb11627e-7cde-47ee-b77e-b1a43eb22d80 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:10.856583 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cb11627e-7cde-47ee-b77e-b1a43eb22d80 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:10.857045 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cb11627e-7cde-47ee-b77e-b1a43eb22d80 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:10.862286 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f4b50f38-1eaf-449a-b6bf-9fce90da6c1d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:10.870135 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f4b50f38-1eaf-449a-b6bf-9fce90da6c1d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 200 len: 1313 microversion: 2.1 time: 0.148080 May 09 23:10:10.870721 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 406/802] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:10 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:10.986884 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cb11627e-7cde-47ee-b77e-b1a43eb22d80 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:10.994147 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cb11627e-7cde-47ee-b77e-b1a43eb22d80 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1674 microversion: 2.1 time: 0.151891 May 09 23:10:10.994735 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 397/803] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:10 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:10:11.886907 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-4e7d78ed-1ec9-4c77-a184-5ef0fbe7a871 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:11.887523 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-4e7d78ed-1ec9-4c77-a184-5ef0fbe7a871 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:11.893768 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4e7d78ed-1ec9-4c77-a184-5ef0fbe7a871 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:11.894255 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4e7d78ed-1ec9-4c77-a184-5ef0fbe7a871 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:11.895024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4e7d78ed-1ec9-4c77-a184-5ef0fbe7a871 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:11.895460 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4e7d78ed-1ec9-4c77-a184-5ef0fbe7a871 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:12.011588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-78daf8ef-9e7c-4a44-ad71-75fcd96aee8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:12.012209 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-78daf8ef-9e7c-4a44-ad71-75fcd96aee8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:12.018859 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-78daf8ef-9e7c-4a44-ad71-75fcd96aee8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:12.019330 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-78daf8ef-9e7c-4a44-ad71-75fcd96aee8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:12.020102 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-78daf8ef-9e7c-4a44-ad71-75fcd96aee8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:12.020544 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-78daf8ef-9e7c-4a44-ad71-75fcd96aee8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:12.150613 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-78daf8ef-9e7c-4a44-ad71-75fcd96aee8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:12.157901 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-78daf8ef-9e7c-4a44-ad71-75fcd96aee8a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1674 microversion: 2.1 time: 0.150223 May 09 23:10:12.158523 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 398/804] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:12 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:10:12.186454 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4e7d78ed-1ec9-4c77-a184-5ef0fbe7a871 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:12.193535 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-4e7d78ed-1ec9-4c77-a184-5ef0fbe7a871 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 200 len: 1313 microversion: 2.1 time: 0.310797 May 09 23:10:12.194094 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 407/805] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:11 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:13.175543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-554eef58-e834-4174-8596-894673a6da1c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:13.176154 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-554eef58-e834-4174-8596-894673a6da1c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:13.182450 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-554eef58-e834-4174-8596-894673a6da1c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:13.182900 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-554eef58-e834-4174-8596-894673a6da1c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:13.183660 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-554eef58-e834-4174-8596-894673a6da1c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:13.184094 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-554eef58-e834-4174-8596-894673a6da1c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:13.210074 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d2b8dc3a-c7fa-4b08-abf0-23ba22721f7d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:13.210692 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d2b8dc3a-c7fa-4b08-abf0-23ba22721f7d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:13.217650 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d2b8dc3a-c7fa-4b08-abf0-23ba22721f7d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:13.218096 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d2b8dc3a-c7fa-4b08-abf0-23ba22721f7d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:13.218884 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d2b8dc3a-c7fa-4b08-abf0-23ba22721f7d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:13.219314 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d2b8dc3a-c7fa-4b08-abf0-23ba22721f7d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:13.312255 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-554eef58-e834-4174-8596-894673a6da1c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:13.319526 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-554eef58-e834-4174-8596-894673a6da1c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1674 microversion: 2.1 time: 0.147752 May 09 23:10:13.320189 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 399/806] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:13 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:13.345518 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d2b8dc3a-c7fa-4b08-abf0-23ba22721f7d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:13.352594 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d2b8dc3a-c7fa-4b08-abf0-23ba22721f7d tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 200 len: 1313 microversion: 2.1 time: 0.146305 May 09 23:10:13.353754 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 408/807] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:13 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:10:14.336577 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-7b3c52df-eccd-45b8-9800-4bd3e07e0fee tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:14.338487 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-7b3c52df-eccd-45b8-9800-4bd3e07e0fee tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:14.346634 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7b3c52df-eccd-45b8-9800-4bd3e07e0fee tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:14.347117 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7b3c52df-eccd-45b8-9800-4bd3e07e0fee tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:14.347959 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7b3c52df-eccd-45b8-9800-4bd3e07e0fee tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:14.348398 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7b3c52df-eccd-45b8-9800-4bd3e07e0fee tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:14.369861 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-48465b4f-1afe-469f-bb83-2748e0626557 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:14.370535 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-48465b4f-1afe-469f-bb83-2748e0626557 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:14.376801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-48465b4f-1afe-469f-bb83-2748e0626557 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:14.377255 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-48465b4f-1afe-469f-bb83-2748e0626557 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:14.378080 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-48465b4f-1afe-469f-bb83-2748e0626557 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:14.378551 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-48465b4f-1afe-469f-bb83-2748e0626557 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:14.476207 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-7b3c52df-eccd-45b8-9800-4bd3e07e0fee tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:14.483956 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-7b3c52df-eccd-45b8-9800-4bd3e07e0fee tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1674 microversion: 2.1 time: 0.151213 May 09 23:10:14.484540 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 400/808] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:14 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:14.507990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-48465b4f-1afe-469f-bb83-2748e0626557 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:14.515825 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-48465b4f-1afe-469f-bb83-2748e0626557 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 200 len: 1313 microversion: 2.1 time: 0.150041 May 09 23:10:14.516374 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 409/809] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:14 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:10:15.500831 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-bd40b361-4f2f-429d-b413-a572a2566c65 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:15.501451 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-bd40b361-4f2f-429d-b413-a572a2566c65 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:15.507691 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bd40b361-4f2f-429d-b413-a572a2566c65 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:15.508147 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bd40b361-4f2f-429d-b413-a572a2566c65 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:15.508943 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bd40b361-4f2f-429d-b413-a572a2566c65 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:15.510058 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bd40b361-4f2f-429d-b413-a572a2566c65 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:15.532797 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-65bd2090-b1b1-41a9-89d7-f7369fe3b3c0 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:15.533552 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-65bd2090-b1b1-41a9-89d7-f7369fe3b3c0 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:15.539860 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-65bd2090-b1b1-41a9-89d7-f7369fe3b3c0 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:15.540332 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-65bd2090-b1b1-41a9-89d7-f7369fe3b3c0 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:15.541223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-65bd2090-b1b1-41a9-89d7-f7369fe3b3c0 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:15.541695 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-65bd2090-b1b1-41a9-89d7-f7369fe3b3c0 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:15.650890 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-bd40b361-4f2f-429d-b413-a572a2566c65 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:15.658227 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-bd40b361-4f2f-429d-b413-a572a2566c65 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1674 microversion: 2.1 time: 0.161239 May 09 23:10:15.658810 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 401/810] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:15 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:15.671886 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-65bd2090-b1b1-41a9-89d7-f7369fe3b3c0 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:15.679337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-65bd2090-b1b1-41a9-89d7-f7369fe3b3c0 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 200 len: 1313 microversion: 2.1 time: 0.150401 May 09 23:10:15.679891 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 410/811] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:15 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:10:15.956065 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-5fd1faca-2d18-486f-b91c-777949e4015a req-439820ff-fbc4-4f9e-b395-929c70b7576f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd1bf588-de21-4f1e-ae63-9b304a0c9cb5", "name": "network-vif-plugged", "status": "completed", "tag": "f7f7e28a-dd0e-413a-aac6-da9fc10fde66"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:10:15.964483 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-5fd1faca-2d18-486f-b91c-777949e4015a req-439820ff-fbc4-4f9e-b395-929c70b7576f service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:15.965116 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-5fd1faca-2d18-486f-b91c-777949e4015a req-439820ff-fbc4-4f9e-b395-929c70b7576f service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:15.976470 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-5fd1faca-2d18-486f-b91c-777949e4015a req-439820ff-fbc4-4f9e-b395-929c70b7576f service nova] Creating event network-vif-plugged:f7f7e28a-dd0e-413a-aac6-da9fc10fde66 for instance fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 on hv-cinder-84067 May 09 23:10:15.982136 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-5fd1faca-2d18-486f-b91c-777949e4015a req-439820ff-fbc4-4f9e-b395-929c70b7576f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029581 May 09 23:10:15.982859 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 402/812] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:10:16.674306 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7e1bd1a5-7996-4a3c-af10-8e2a163f9bad tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:16.674923 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7e1bd1a5-7996-4a3c-af10-8e2a163f9bad tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:16.680993 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7e1bd1a5-7996-4a3c-af10-8e2a163f9bad tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:16.681385 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7e1bd1a5-7996-4a3c-af10-8e2a163f9bad tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:16.682174 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7e1bd1a5-7996-4a3c-af10-8e2a163f9bad tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:16.682621 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7e1bd1a5-7996-4a3c-af10-8e2a163f9bad tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:16.699209 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c84df4a6-cc71-46be-a9ac-19b89e44d24a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:16.700747 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c84df4a6-cc71-46be-a9ac-19b89e44d24a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:16.708638 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c84df4a6-cc71-46be-a9ac-19b89e44d24a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:16.709289 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c84df4a6-cc71-46be-a9ac-19b89e44d24a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:16.710345 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c84df4a6-cc71-46be-a9ac-19b89e44d24a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:16.710840 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c84df4a6-cc71-46be-a9ac-19b89e44d24a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:16.825185 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7e1bd1a5-7996-4a3c-af10-8e2a163f9bad tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:16.834349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7e1bd1a5-7996-4a3c-af10-8e2a163f9bad tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1651 microversion: 2.1 time: 0.163230 May 09 23:10:16.834928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 411/813] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:16 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1651 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:16.852543 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-34eaffb9-9698-4fc2-84c0-6558f1574aa2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:10:16.856168 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c84df4a6-cc71-46be-a9ac-19b89e44d24a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:16.863457 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-34eaffb9-9698-4fc2-84c0-6558f1574aa2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:16.863669 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c84df4a6-cc71-46be-a9ac-19b89e44d24a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 200 len: 1313 microversion: 2.1 time: 0.170417 May 09 23:10:16.863782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-34eaffb9-9698-4fc2-84c0-6558f1574aa2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:16.864236 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 403/814] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:16 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:10:16.889812 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-34eaffb9-9698-4fc2-84c0-6558f1574aa2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Going to try to start instance {{(pid=117143) start /opt/stack/nova/nova/compute/api.py:2730}} May 09 23:10:16.933920 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-34eaffb9-9698-4fc2-84c0-6558f1574aa2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "POST /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/action" status: 202 len: 0 microversion: 2.1 time: 0.085606 May 09 23:10:16.934494 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 412/815] 10.222.0.23 () {60 vars in 1277 bytes} [Mon May 9 23:10:16 2022] POST /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 23:10:16.942682 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-54a8840b-fb0b-473a-b187-5beabb5c9eba tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:16.943528 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-54a8840b-fb0b-473a-b187-5beabb5c9eba tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:16.951509 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-54a8840b-fb0b-473a-b187-5beabb5c9eba tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:16.952031 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-54a8840b-fb0b-473a-b187-5beabb5c9eba tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:16.953103 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-54a8840b-fb0b-473a-b187-5beabb5c9eba tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:16.953830 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-54a8840b-fb0b-473a-b187-5beabb5c9eba tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:17.142889 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-54a8840b-fb0b-473a-b187-5beabb5c9eba tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:17.152157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-54a8840b-fb0b-473a-b187-5beabb5c9eba tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1660 microversion: 2.1 time: 0.213455 May 09 23:10:17.153594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 404/816] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:16 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1660 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:17.882259 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b72bf3d3-f72c-47c3-881b-8756282ff1ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:17.883380 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b72bf3d3-f72c-47c3-881b-8756282ff1ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:17.893571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b72bf3d3-f72c-47c3-881b-8756282ff1ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:17.894295 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b72bf3d3-f72c-47c3-881b-8756282ff1ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:17.895088 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b72bf3d3-f72c-47c3-881b-8756282ff1ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:17.895932 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b72bf3d3-f72c-47c3-881b-8756282ff1ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:18.062438 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b72bf3d3-f72c-47c3-881b-8756282ff1ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:18.070821 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b72bf3d3-f72c-47c3-881b-8756282ff1ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 200 len: 1497 microversion: 2.1 time: 0.193434 May 09 23:10:18.071677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 413/817] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:17 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:10:18.171175 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-bdc00812-5d88-4eac-959e-3b5b71c8ff6f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:18.171843 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-bdc00812-5d88-4eac-959e-3b5b71c8ff6f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:18.178866 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bdc00812-5d88-4eac-959e-3b5b71c8ff6f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:18.179321 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bdc00812-5d88-4eac-959e-3b5b71c8ff6f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:18.180145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bdc00812-5d88-4eac-959e-3b5b71c8ff6f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:18.180578 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-bdc00812-5d88-4eac-959e-3b5b71c8ff6f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:18.360578 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-bdc00812-5d88-4eac-959e-3b5b71c8ff6f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:18.368272 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-bdc00812-5d88-4eac-959e-3b5b71c8ff6f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1660 microversion: 2.1 time: 0.201099 May 09 23:10:18.369548 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 405/818] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:18 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1660 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:18.489870 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-9fd25da0-aa35-44d8-a106-fd0d9e1a7a91 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:18.490390 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-9fd25da0-aa35-44d8-a106-fd0d9e1a7a91 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:18.496113 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9fd25da0-aa35-44d8-a106-fd0d9e1a7a91 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:18.496560 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9fd25da0-aa35-44d8-a106-fd0d9e1a7a91 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:18.497318 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9fd25da0-aa35-44d8-a106-fd0d9e1a7a91 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:18.497744 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9fd25da0-aa35-44d8-a106-fd0d9e1a7a91 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:18.523453 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-9fd25da0-aa35-44d8-a106-fd0d9e1a7a91 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Going to try to terminate instance {{(pid=117143) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:10:18.599208 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-9fd25da0-aa35-44d8-a106-fd0d9e1a7a91 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 204 len: 0 microversion: 2.1 time: 0.117220 May 09 23:10:18.599781 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 414/819] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:10:18 2022] DELETE /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:10:18.608741 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d414a795-dcd0-4204-9dde-4291718bcf84 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:18.609437 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-d414a795-dcd0-4204-9dde-4291718bcf84 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:18.615245 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d414a795-dcd0-4204-9dde-4291718bcf84 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:18.615842 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d414a795-dcd0-4204-9dde-4291718bcf84 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:18.616652 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d414a795-dcd0-4204-9dde-4291718bcf84 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:18.617158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d414a795-dcd0-4204-9dde-4291718bcf84 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:18.762339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-d414a795-dcd0-4204-9dde-4291718bcf84 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:18.769634 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d414a795-dcd0-4204-9dde-4291718bcf84 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 200 len: 1503 microversion: 2.1 time: 0.165046 May 09 23:10:18.770232 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 406/820] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:18 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:19.386309 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-56220bdf-f14c-434c-9e7b-aaf0082ac2a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:19.387574 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-56220bdf-f14c-434c-9e7b-aaf0082ac2a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:19.394108 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-56220bdf-f14c-434c-9e7b-aaf0082ac2a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:19.394810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-56220bdf-f14c-434c-9e7b-aaf0082ac2a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:19.395818 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-56220bdf-f14c-434c-9e7b-aaf0082ac2a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:19.396259 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-56220bdf-f14c-434c-9e7b-aaf0082ac2a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:19.535804 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-56220bdf-f14c-434c-9e7b-aaf0082ac2a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:19.544052 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-56220bdf-f14c-434c-9e7b-aaf0082ac2a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1664 microversion: 2.1 time: 0.161917 May 09 23:10:19.544617 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 415/821] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:19 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1664 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:19.788492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e1403db3-cdac-4fb3-a7bc-26fe993229a4 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:19.789022 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e1403db3-cdac-4fb3-a7bc-26fe993229a4 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:19.795396 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e1403db3-cdac-4fb3-a7bc-26fe993229a4 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:19.795843 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e1403db3-cdac-4fb3-a7bc-26fe993229a4 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:19.796602 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e1403db3-cdac-4fb3-a7bc-26fe993229a4 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:19.797036 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e1403db3-cdac-4fb3-a7bc-26fe993229a4 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:19.922094 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e1403db3-cdac-4fb3-a7bc-26fe993229a4 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:19.929320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e1403db3-cdac-4fb3-a7bc-26fe993229a4 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 200 len: 1503 microversion: 2.1 time: 0.145491 May 09 23:10:19.929893 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 407/822] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:19 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:20.546519 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-f8a87573-2ab4-4388-9a7a-df92d0812b8f req-7159a50f-6b1d-42e3-a638-2ccdb0327bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd1bf588-de21-4f1e-ae63-9b304a0c9cb5", "name": "network-vif-deleted", "tag": "f7f7e28a-dd0e-413a-aac6-da9fc10fde66"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:10:20.555381 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-f8a87573-2ab4-4388-9a7a-df92d0812b8f req-7159a50f-6b1d-42e3-a638-2ccdb0327bdf service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:20.555995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-f8a87573-2ab4-4388-9a7a-df92d0812b8f req-7159a50f-6b1d-42e3-a638-2ccdb0327bdf service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:20.568931 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-f8a87573-2ab4-4388-9a7a-df92d0812b8f req-7159a50f-6b1d-42e3-a638-2ccdb0327bdf service nova] Creating event network-vif-deleted:f7f7e28a-dd0e-413a-aac6-da9fc10fde66 for instance fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 on hv-cinder-84067 May 09 23:10:20.574907 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-f8a87573-2ab4-4388-9a7a-df92d0812b8f req-7159a50f-6b1d-42e3-a638-2ccdb0327bdf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032905 May 09 23:10:20.575762 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 416/823] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:10:20.947313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-77e833f7-ba82-4c8b-821b-9517d817bbbf tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:20.947924 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-77e833f7-ba82-4c8b-821b-9517d817bbbf tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:20.954159 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-77e833f7-ba82-4c8b-821b-9517d817bbbf tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:20.954603 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-77e833f7-ba82-4c8b-821b-9517d817bbbf tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:20.955365 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-77e833f7-ba82-4c8b-821b-9517d817bbbf tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:20.955801 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-77e833f7-ba82-4c8b-821b-9517d817bbbf tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:20.984796 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-77e833f7-ba82-4c8b-821b-9517d817bbbf tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:20.985235 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-77e833f7-ba82-4c8b-821b-9517d817bbbf tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:20.985676 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-77e833f7-ba82-4c8b-821b-9517d817bbbf tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lazy-loading 'fault' on Instance uuid fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:10:21.028764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-77e833f7-ba82-4c8b-821b-9517d817bbbf tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:21.035949 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-77e833f7-ba82-4c8b-821b-9517d817bbbf tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 200 len: 1303 microversion: 2.1 time: 0.093051 May 09 23:10:21.036513 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 408/824] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:20 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:22.053863 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-84503482-8e39-4241-a419-04cde70c9030 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:22.054605 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-84503482-8e39-4241-a419-04cde70c9030 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: fd1bf588-de21-4f1e-ae63-9b304a0c9cb5] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:22.060542 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84503482-8e39-4241-a419-04cde70c9030 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:22.065068 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84503482-8e39-4241-a419-04cde70c9030 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:22.065865 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84503482-8e39-4241-a419-04cde70c9030 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:22.066350 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84503482-8e39-4241-a419-04cde70c9030 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:22.080005 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-84503482-8e39-4241-a419-04cde70c9030 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] HTTP exception thrown: Instance fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 could not be found. May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-84503482-8e39-4241-a419-04cde70c9030 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Request method failure captured: May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 HTTP/1.1 May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ9I8zZoqBRb4wPFG8YwAho2JCKJo3fiDrWDaZWZDGJvgXja_fUQ81SwYtZzM6DYWKBR05tNstLE-n4p5wQVE3QqKr8WHVTwyEHcqXjTrqp7nLPOb0ZV7ftmodFxiylPN8PAPOsiPykOF6Q1o_KV1CiVgJbXYeHJci6ZYuQQuWFE4io May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: f99e7d13264c4801bbd78669d85fd6ce May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-VolumesActionsTest-1093425313 May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:10:22.081620 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:10:22.083243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f99e7d13264c4801bbd78669d85fd6ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f99e7d13264c4801bbd78669d85fd6ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f99e7d13264c4801bbd78669d85fd6ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f99e7d13264c4801bbd78669d85fd6ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:10:22.083243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-VolumesActionsTest-1093425313 May 09 23:10:22.083243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: f99e7d13264c4801bbd78669d85fd6ce May 09 23:10:22.083243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-VolumesActionsTest-1093425313 May 09 23:10:22.083243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-VolumesActionsTest-1093425313-project May 09 23:10:22.083243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:10:22.083243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:10:22.083243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 8f0d8c487e3a4570abea4ad26bcaa34a May 09 23:10:22.083243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-VolumesActionsTest-1093425313-project May 09 23:10:22.083243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:10:22.083243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 could not be found. May 09 23:10:22.083243 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': 'fd1bf588-de21-4f1e-ae63-9b304a0c9cb5'} May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 could not be found. May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:10:22.084384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 could not be found. May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 could not be found. May 09 23:10:22.085659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:10:22.086802 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-84503482-8e39-4241-a419-04cde70c9030 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Returning 404 to user: Instance fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:10:22.086802 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-84503482-8e39-4241-a419-04cde70c9030 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5" status: 404 len: 111 microversion: 2.1 time: 0.034111 May 09 23:10:22.086802 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 417/825] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:22 2022] GET /compute/v2.1/servers/fd1bf588-de21-4f1e-ae63-9b304a0c9cb5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:10:22.178418 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1888250474", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "networks": [{"uuid": "dd59166f-fc33-4aba-ba9d-e309f5309b64"}]}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:10:22.228580 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.network.neutron [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] validate_networks() for [('dd59166f-fc33-4aba-ba9d-e309f5309b64', None, None, None, None, None)] {{(pid=117142) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:10:22.900763 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Flavor limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:10:22.901204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Image limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:10:22.901667 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Flavor pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:10:22.902079 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Image pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:10:22.902519 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:10:22.911185 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:22.911637 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:22.912448 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:22.912887 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:22.928988 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Getting quotas for project f99e7d13264c4801bbd78669d85fd6ce. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:10:22.933427 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Getting quotas for user 8f0d8c487e3a4570abea4ad26bcaa34a and project f99e7d13264c4801bbd78669d85fd6ce. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:10:22.944832 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Going to run 1 instances... {{(pid=117142) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:10:22.947698 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:10:22.992789 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-4d6e3d37-99f8-4591-92b4-c7637c2121d7 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818307 May 09 23:10:22.993995 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 409/826] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:10:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:10:23.003798 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e4a598b0-fbfa-480a-b510-25a361939e5a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:23.004439 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e4a598b0-fbfa-480a-b510-25a361939e5a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:23.069053 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e4a598b0-fbfa-480a-b510-25a361939e5a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:23.077268 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e4a598b0-fbfa-480a-b510-25a361939e5a tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 200 len: 1214 microversion: 2.1 time: 0.077320 May 09 23:10:23.078138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 418/827] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:22 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:24.094900 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1980f9eb-222b-4212-a2d1-9a029476f138 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:24.095608 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1980f9eb-222b-4212-a2d1-9a029476f138 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:24.103943 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1980f9eb-222b-4212-a2d1-9a029476f138 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:24.104645 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1980f9eb-222b-4212-a2d1-9a029476f138 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:24.105896 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1980f9eb-222b-4212-a2d1-9a029476f138 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:24.106360 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1980f9eb-222b-4212-a2d1-9a029476f138 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:24.181845 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1980f9eb-222b-4212-a2d1-9a029476f138 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:24.190631 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1980f9eb-222b-4212-a2d1-9a029476f138 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 200 len: 1274 microversion: 2.1 time: 0.100252 May 09 23:10:24.191452 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 410/828] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:24 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:25.208021 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c6f971fd-8a94-4405-9f21-b1baa51c0ab3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:25.208555 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c6f971fd-8a94-4405-9f21-b1baa51c0ab3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:25.215522 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c6f971fd-8a94-4405-9f21-b1baa51c0ab3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:25.215974 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c6f971fd-8a94-4405-9f21-b1baa51c0ab3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:25.216753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c6f971fd-8a94-4405-9f21-b1baa51c0ab3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:25.217184 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c6f971fd-8a94-4405-9f21-b1baa51c0ab3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:25.681171 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c6f971fd-8a94-4405-9f21-b1baa51c0ab3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:25.693494 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c6f971fd-8a94-4405-9f21-b1baa51c0ab3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 200 len: 1314 microversion: 2.1 time: 0.489278 May 09 23:10:25.694439 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 419/829] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:25 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:25.908381 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-bd422b59-f356-490b-84ce-ae9770a8d5e5 req-283776a6-9bb5-47cf-b640-8af49c0f6fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bb2c49f-f668-4f8b-90e1-7b98896b5117", "tag": "13a974be-3118-459a-8b6f-840dce874cc0"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:10:25.923054 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-bd422b59-f356-490b-84ce-ae9770a8d5e5 req-283776a6-9bb5-47cf-b640-8af49c0f6fd3 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:25.923638 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-bd422b59-f356-490b-84ce-ae9770a8d5e5 req-283776a6-9bb5-47cf-b640-8af49c0f6fd3 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:25.949668 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-bd422b59-f356-490b-84ce-ae9770a8d5e5 req-283776a6-9bb5-47cf-b640-8af49c0f6fd3 service nova] Creating event network-changed:13a974be-3118-459a-8b6f-840dce874cc0 for instance 9bb2c49f-f668-4f8b-90e1-7b98896b5117 on hv-cinder-84067 May 09 23:10:25.954010 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-bd422b59-f356-490b-84ce-ae9770a8d5e5 req-283776a6-9bb5-47cf-b640-8af49c0f6fd3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048691 May 09 23:10:25.954734 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 411/830] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:10:26.710852 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-84f2ff02-c2e6-47b4-bb0a-3f8cb2f7f02c tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:26.711670 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-84f2ff02-c2e6-47b4-bb0a-3f8cb2f7f02c tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:26.717660 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84f2ff02-c2e6-47b4-bb0a-3f8cb2f7f02c tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:26.718100 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84f2ff02-c2e6-47b4-bb0a-3f8cb2f7f02c tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:26.718885 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84f2ff02-c2e6-47b4-bb0a-3f8cb2f7f02c tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:26.719316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84f2ff02-c2e6-47b4-bb0a-3f8cb2f7f02c tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:26.847436 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-84f2ff02-c2e6-47b4-bb0a-3f8cb2f7f02c tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:26.855212 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-84f2ff02-c2e6-47b4-bb0a-3f8cb2f7f02c tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 200 len: 1314 microversion: 2.1 time: 0.148222 May 09 23:10:26.856054 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 420/831] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:26 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:27.872654 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a8fa496d-5ab1-48a5-9392-72385b2bb5ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:27.873346 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a8fa496d-5ab1-48a5-9392-72385b2bb5ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:27.879351 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a8fa496d-5ab1-48a5-9392-72385b2bb5ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:27.879799 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a8fa496d-5ab1-48a5-9392-72385b2bb5ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:27.880582 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a8fa496d-5ab1-48a5-9392-72385b2bb5ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:27.881010 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a8fa496d-5ab1-48a5-9392-72385b2bb5ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:28.014349 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a8fa496d-5ab1-48a5-9392-72385b2bb5ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:28.021959 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a8fa496d-5ab1-48a5-9392-72385b2bb5ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 200 len: 1314 microversion: 2.1 time: 0.153989 May 09 23:10:28.022767 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 412/832] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:27 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:29.038593 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7341f4e7-b4ef-490f-9d42-2eb5af3649c3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:29.039203 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7341f4e7-b4ef-490f-9d42-2eb5af3649c3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:29.045986 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7341f4e7-b4ef-490f-9d42-2eb5af3649c3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:29.046461 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7341f4e7-b4ef-490f-9d42-2eb5af3649c3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:29.047220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7341f4e7-b4ef-490f-9d42-2eb5af3649c3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:29.047653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7341f4e7-b4ef-490f-9d42-2eb5af3649c3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:29.179021 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7341f4e7-b4ef-490f-9d42-2eb5af3649c3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:29.186542 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7341f4e7-b4ef-490f-9d42-2eb5af3649c3 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 200 len: 1314 microversion: 2.1 time: 0.151789 May 09 23:10:29.187119 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 421/833] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:29 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:30.204060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-78d7df5a-5d83-4c49-adc9-070c0ffc40d5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:30.204645 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-78d7df5a-5d83-4c49-adc9-070c0ffc40d5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:30.210914 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-78d7df5a-5d83-4c49-adc9-070c0ffc40d5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:30.211388 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-78d7df5a-5d83-4c49-adc9-070c0ffc40d5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:30.212142 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-78d7df5a-5d83-4c49-adc9-070c0ffc40d5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:30.212568 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-78d7df5a-5d83-4c49-adc9-070c0ffc40d5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:30.346633 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-78d7df5a-5d83-4c49-adc9-070c0ffc40d5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:30.354729 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-78d7df5a-5d83-4c49-adc9-070c0ffc40d5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 200 len: 1314 microversion: 2.1 time: 0.154449 May 09 23:10:30.355391 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 413/834] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:30 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:31.371499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-67fbd39b-0576-4da0-af5e-960fda575408 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:31.372118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-67fbd39b-0576-4da0-af5e-960fda575408 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:31.378418 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-67fbd39b-0576-4da0-af5e-960fda575408 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:31.378872 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-67fbd39b-0576-4da0-af5e-960fda575408 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:31.379646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-67fbd39b-0576-4da0-af5e-960fda575408 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:31.380086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-67fbd39b-0576-4da0-af5e-960fda575408 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:31.519244 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-67fbd39b-0576-4da0-af5e-960fda575408 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:31.527048 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-67fbd39b-0576-4da0-af5e-960fda575408 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 200 len: 1314 microversion: 2.1 time: 0.159377 May 09 23:10:31.527627 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 422/835] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:31 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:32.025591 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-c2d61875-e97a-408b-a2b4-42427796303a req-cfa2698e-8eba-460c-8dfe-c8288dd9e81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb2c49f-f668-4f8b-90e1-7b98896b5117", "name": "network-vif-plugged", "status": "completed", "tag": "13a974be-3118-459a-8b6f-840dce874cc0"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:10:32.034725 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-c2d61875-e97a-408b-a2b4-42427796303a req-cfa2698e-8eba-460c-8dfe-c8288dd9e81d service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:32.035167 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-c2d61875-e97a-408b-a2b4-42427796303a req-cfa2698e-8eba-460c-8dfe-c8288dd9e81d service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:32.046087 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-c2d61875-e97a-408b-a2b4-42427796303a req-cfa2698e-8eba-460c-8dfe-c8288dd9e81d service nova] Creating event network-vif-plugged:13a974be-3118-459a-8b6f-840dce874cc0 for instance 9bb2c49f-f668-4f8b-90e1-7b98896b5117 on hv-cinder-84067 May 09 23:10:32.051000 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-c2d61875-e97a-408b-a2b4-42427796303a req-cfa2698e-8eba-460c-8dfe-c8288dd9e81d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029009 May 09 23:10:32.051698 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 414/836] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:10:32.543655 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-68369f2d-b9e0-4d75-ae1f-b0763bf95ad5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:32.544281 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-68369f2d-b9e0-4d75-ae1f-b0763bf95ad5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:32.550521 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-68369f2d-b9e0-4d75-ae1f-b0763bf95ad5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:32.550962 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-68369f2d-b9e0-4d75-ae1f-b0763bf95ad5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:32.551740 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-68369f2d-b9e0-4d75-ae1f-b0763bf95ad5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:32.552166 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-68369f2d-b9e0-4d75-ae1f-b0763bf95ad5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:32.685017 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-68369f2d-b9e0-4d75-ae1f-b0763bf95ad5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:32.692386 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-68369f2d-b9e0-4d75-ae1f-b0763bf95ad5 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 200 len: 1314 microversion: 2.1 time: 0.152553 May 09 23:10:32.692958 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 423/837] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:32 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:33.709667 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fc57bced-16fc-429a-812c-a0fe838a80e8 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:33.710501 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-fc57bced-16fc-429a-812c-a0fe838a80e8 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:33.717180 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fc57bced-16fc-429a-812c-a0fe838a80e8 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:33.717632 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fc57bced-16fc-429a-812c-a0fe838a80e8 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:33.718540 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fc57bced-16fc-429a-812c-a0fe838a80e8 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:33.719004 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fc57bced-16fc-429a-812c-a0fe838a80e8 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:33.853826 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-fc57bced-16fc-429a-812c-a0fe838a80e8 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:33.861534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-fc57bced-16fc-429a-812c-a0fe838a80e8 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 200 len: 1314 microversion: 2.1 time: 0.156523 May 09 23:10:33.862103 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 415/838] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:33 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:34.877571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2e7d6eda-510b-4aa8-b938-f3f9424d3f19 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:34.878200 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2e7d6eda-510b-4aa8-b938-f3f9424d3f19 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:34.884382 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2e7d6eda-510b-4aa8-b938-f3f9424d3f19 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:34.884819 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2e7d6eda-510b-4aa8-b938-f3f9424d3f19 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:34.885575 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2e7d6eda-510b-4aa8-b938-f3f9424d3f19 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:34.886049 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2e7d6eda-510b-4aa8-b938-f3f9424d3f19 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:35.056986 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2e7d6eda-510b-4aa8-b938-f3f9424d3f19 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:35.064696 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2e7d6eda-510b-4aa8-b938-f3f9424d3f19 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 200 len: 1498 microversion: 2.1 time: 0.190875 May 09 23:10:35.065267 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 424/839] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:34 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 1498 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:35.490145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-570765db-4736-4598-80a6-363ed87781c1 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:35.490646 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-570765db-4736-4598-80a6-363ed87781c1 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:35.496677 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-570765db-4736-4598-80a6-363ed87781c1 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:35.497122 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-570765db-4736-4598-80a6-363ed87781c1 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:35.498377 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-570765db-4736-4598-80a6-363ed87781c1 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:35.498815 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-570765db-4736-4598-80a6-363ed87781c1 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:35.524998 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-570765db-4736-4598-80a6-363ed87781c1 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Going to try to terminate instance {{(pid=117142) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:10:35.600232 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-570765db-4736-4598-80a6-363ed87781c1 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 204 len: 0 microversion: 2.1 time: 0.113640 May 09 23:10:35.600831 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 416/840] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:10:35 2022] DELETE /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:10:35.610983 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-16f28509-4ad2-46b9-b353-c17ccfdd87ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:35.611712 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-16f28509-4ad2-46b9-b353-c17ccfdd87ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:35.618864 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-16f28509-4ad2-46b9-b353-c17ccfdd87ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:35.619409 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-16f28509-4ad2-46b9-b353-c17ccfdd87ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:35.620811 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-16f28509-4ad2-46b9-b353-c17ccfdd87ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:35.621488 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-16f28509-4ad2-46b9-b353-c17ccfdd87ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:35.765195 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-16f28509-4ad2-46b9-b353-c17ccfdd87ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:35.772404 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-16f28509-4ad2-46b9-b353-c17ccfdd87ae tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 200 len: 1504 microversion: 2.1 time: 0.166541 May 09 23:10:35.772966 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 425/841] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:35 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:36.791241 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e4a5cca7-eee5-4638-9bc0-1664d7a97912 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:36.792066 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e4a5cca7-eee5-4638-9bc0-1664d7a97912 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:36.798499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e4a5cca7-eee5-4638-9bc0-1664d7a97912 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:36.798979 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e4a5cca7-eee5-4638-9bc0-1664d7a97912 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:36.799759 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e4a5cca7-eee5-4638-9bc0-1664d7a97912 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:36.800183 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e4a5cca7-eee5-4638-9bc0-1664d7a97912 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:36.935034 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e4a5cca7-eee5-4638-9bc0-1664d7a97912 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:36.946276 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e4a5cca7-eee5-4638-9bc0-1664d7a97912 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 200 len: 1504 microversion: 2.1 time: 0.159117 May 09 23:10:36.946857 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 417/842] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:36 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:37.599778 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-45b9fcba-8b38-465f-9914-2c604bd984ed req-05a14cd8-a15b-4b57-9489-693c1b2150c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb2c49f-f668-4f8b-90e1-7b98896b5117", "name": "network-vif-deleted", "tag": "13a974be-3118-459a-8b6f-840dce874cc0"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:10:37.610663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-45b9fcba-8b38-465f-9914-2c604bd984ed req-05a14cd8-a15b-4b57-9489-693c1b2150c3 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:37.611111 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-45b9fcba-8b38-465f-9914-2c604bd984ed req-05a14cd8-a15b-4b57-9489-693c1b2150c3 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:37.624214 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-45b9fcba-8b38-465f-9914-2c604bd984ed req-05a14cd8-a15b-4b57-9489-693c1b2150c3 service nova] Creating event network-vif-deleted:13a974be-3118-459a-8b6f-840dce874cc0 for instance 9bb2c49f-f668-4f8b-90e1-7b98896b5117 on hv-cinder-84067 May 09 23:10:37.630809 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-45b9fcba-8b38-465f-9914-2c604bd984ed req-05a14cd8-a15b-4b57-9489-693c1b2150c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034817 May 09 23:10:37.631485 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 426/843] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:10:37.963743 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fae737c3-b5a0-4df5-b41e-f6ce0620f77b tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:37.965568 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-fae737c3-b5a0-4df5-b41e-f6ce0620f77b tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:37.971878 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fae737c3-b5a0-4df5-b41e-f6ce0620f77b tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:37.972329 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fae737c3-b5a0-4df5-b41e-f6ce0620f77b tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:37.973107 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fae737c3-b5a0-4df5-b41e-f6ce0620f77b tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:37.973575 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fae737c3-b5a0-4df5-b41e-f6ce0620f77b tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:38.008408 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fae737c3-b5a0-4df5-b41e-f6ce0620f77b tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:38.008867 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fae737c3-b5a0-4df5-b41e-f6ce0620f77b tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:38.009322 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-fae737c3-b5a0-4df5-b41e-f6ce0620f77b tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lazy-loading 'fault' on Instance uuid 9bb2c49f-f668-4f8b-90e1-7b98896b5117 {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:10:38.074957 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-fae737c3-b5a0-4df5-b41e-f6ce0620f77b tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d8c487e3a4570abea4ad26bcaa34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99e7d13264c4801bbd78669d85fd6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:38.082984 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-fae737c3-b5a0-4df5-b41e-f6ce0620f77b tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 200 len: 1304 microversion: 2.1 time: 0.123329 May 09 23:10:38.083567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 418/844] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:37 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:39.101586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-778fa0c6-be93-46c2-997f-5d7afbcc50b9 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:39.102880 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-778fa0c6-be93-46c2-997f-5d7afbcc50b9 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] [instance: 9bb2c49f-f668-4f8b-90e1-7b98896b5117] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:39.109961 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-778fa0c6-be93-46c2-997f-5d7afbcc50b9 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:39.110583 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-778fa0c6-be93-46c2-997f-5d7afbcc50b9 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:39.111323 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-778fa0c6-be93-46c2-997f-5d7afbcc50b9 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:39.112029 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-778fa0c6-be93-46c2-997f-5d7afbcc50b9 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:39.126067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-778fa0c6-be93-46c2-997f-5d7afbcc50b9 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] HTTP exception thrown: Instance 9bb2c49f-f668-4f8b-90e1-7b98896b5117 could not be found. May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-778fa0c6-be93-46c2-997f-5d7afbcc50b9 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Request method failure captured: May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 HTTP/1.1 May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ9I8zZoqBRb4wPFG8YwAho2JCKJo3fiDrWDaZWZDGJvgXja_fUQ81SwYtZzM6DYWKBR05tNstLE-n4p5wQVE3QqKr8WHVTwyEHcqXjTrqp7nLPOb0ZV7ftmodFxiylPN8PAPOsiPykOF6Q1o_KV1CiVgJbXYeHJci6ZYuQQuWFE4io May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: f99e7d13264c4801bbd78669d85fd6ce May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-VolumesActionsTest-1093425313 May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:10:39.127753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:10:39.129372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f99e7d13264c4801bbd78669d85fd6ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f99e7d13264c4801bbd78669d85fd6ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f99e7d13264c4801bbd78669d85fd6ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f99e7d13264c4801bbd78669d85fd6ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:10:39.129372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-VolumesActionsTest-1093425313 May 09 23:10:39.129372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: f99e7d13264c4801bbd78669d85fd6ce May 09 23:10:39.129372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-VolumesActionsTest-1093425313 May 09 23:10:39.129372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-VolumesActionsTest-1093425313-project May 09 23:10:39.129372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:10:39.129372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:10:39.129372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 8f0d8c487e3a4570abea4ad26bcaa34a May 09 23:10:39.129372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-VolumesActionsTest-1093425313-project May 09 23:10:39.129372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:10:39.129372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance 9bb2c49f-f668-4f8b-90e1-7b98896b5117 could not be found. May 09 23:10:39.129372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': '9bb2c49f-f668-4f8b-90e1-7b98896b5117'} May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bb2c49f-f668-4f8b-90e1-7b98896b5117 could not be found. May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:10:39.130316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bb2c49f-f668-4f8b-90e1-7b98896b5117 could not be found. May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bb2c49f-f668-4f8b-90e1-7b98896b5117 could not be found. May 09 23:10:39.131805 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:10:39.132903 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-778fa0c6-be93-46c2-997f-5d7afbcc50b9 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] Returning 404 to user: Instance 9bb2c49f-f668-4f8b-90e1-7b98896b5117 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:10:39.132903 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-778fa0c6-be93-46c2-997f-5d7afbcc50b9 tempest-VolumesActionsTest-1093425313 tempest-VolumesActionsTest-1093425313-project] 10.222.0.23 "GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117" status: 404 len: 111 microversion: 2.1 time: 0.032240 May 09 23:10:39.134331 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 427/845] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:39 2022] GET /compute/v2.1/servers/9bb2c49f-f668-4f8b-90e1-7b98896b5117 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:10:45.422327 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:10:45.422872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Mon May 9 23:10:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 23:10:58.150351 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0e99b5d3-79f4-4b2e-912e-7a59c51ce600 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:58.151520 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-0e99b5d3-79f4-4b2e-912e-7a59c51ce600 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:58.157437 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0e99b5d3-79f4-4b2e-912e-7a59c51ce600 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:58.157891 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0e99b5d3-79f4-4b2e-912e-7a59c51ce600 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:58.158698 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0e99b5d3-79f4-4b2e-912e-7a59c51ce600 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:58.159137 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0e99b5d3-79f4-4b2e-912e-7a59c51ce600 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:58.189061 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0e99b5d3-79f4-4b2e-912e-7a59c51ce600 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043010 May 09 23:10:58.189557 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 419/846] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:10:58 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 23:10:58.250464 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-8750e5c6-520a-40f1-b238-765a6be0a61c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:58.251032 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-8750e5c6-520a-40f1-b238-765a6be0a61c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:58.257302 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8750e5c6-520a-40f1-b238-765a6be0a61c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:58.257757 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8750e5c6-520a-40f1-b238-765a6be0a61c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:58.258597 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8750e5c6-520a-40f1-b238-765a6be0a61c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:58.259038 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8750e5c6-520a-40f1-b238-765a6be0a61c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:58.284033 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-8750e5c6-520a-40f1-b238-765a6be0a61c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Going to try to terminate instance {{(pid=117143) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:10:58.376425 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-8750e5c6-520a-40f1-b238-765a6be0a61c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 204 len: 0 microversion: 2.1 time: 0.129397 May 09 23:10:58.377387 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 428/847] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:10:58 2022] DELETE /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:10:58.386614 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-15f9548c-5842-4e1a-89f7-4ee1e3c872c5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:58.387478 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-15f9548c-5842-4e1a-89f7-4ee1e3c872c5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:58.393461 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-15f9548c-5842-4e1a-89f7-4ee1e3c872c5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:58.393914 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-15f9548c-5842-4e1a-89f7-4ee1e3c872c5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:58.394727 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-15f9548c-5842-4e1a-89f7-4ee1e3c872c5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:58.395181 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-15f9548c-5842-4e1a-89f7-4ee1e3c872c5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:58.531123 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-15f9548c-5842-4e1a-89f7-4ee1e3c872c5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:58.538539 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-15f9548c-5842-4e1a-89f7-4ee1e3c872c5 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1670 microversion: 2.1 time: 0.157116 May 09 23:10:58.539120 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 420/848] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:58 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:10:59.556355 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-baace1fd-7d41-4cda-a69d-7bcf778239da tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:10:59.557170 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-baace1fd-7d41-4cda-a69d-7bcf778239da tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:10:59.563501 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-baace1fd-7d41-4cda-a69d-7bcf778239da tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:59.563956 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-baace1fd-7d41-4cda-a69d-7bcf778239da tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:59.564735 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-baace1fd-7d41-4cda-a69d-7bcf778239da tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:10:59.565173 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-baace1fd-7d41-4cda-a69d-7bcf778239da tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:10:59.703329 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-baace1fd-7d41-4cda-a69d-7bcf778239da tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:10:59.711147 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-baace1fd-7d41-4cda-a69d-7bcf778239da tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1670 microversion: 2.1 time: 0.158970 May 09 23:10:59.711903 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 429/849] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:10:59 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:00.728417 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1f49d40e-e0ec-4355-9363-63e2a05e4079 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:00.729687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1f49d40e-e0ec-4355-9363-63e2a05e4079 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:00.736408 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1f49d40e-e0ec-4355-9363-63e2a05e4079 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:00.736858 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1f49d40e-e0ec-4355-9363-63e2a05e4079 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:00.737628 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1f49d40e-e0ec-4355-9363-63e2a05e4079 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:00.738059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1f49d40e-e0ec-4355-9363-63e2a05e4079 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:00.866078 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1f49d40e-e0ec-4355-9363-63e2a05e4079 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:00.873288 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1f49d40e-e0ec-4355-9363-63e2a05e4079 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1670 microversion: 2.1 time: 0.148771 May 09 23:11:00.873867 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 421/850] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:00 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1670 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:01.520832 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-6b18ed86-2c70-43ae-967a-cfc93346829b req-d205ca00-3d60-4ff1-affa-0b92e0a071aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e8552f4-9cab-423d-ae4f-6790f5de0f91", "name": "network-vif-deleted", "tag": "f0504a29-0f57-4b6a-b659-4d5559910b95"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:11:01.535357 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-6b18ed86-2c70-43ae-967a-cfc93346829b req-d205ca00-3d60-4ff1-affa-0b92e0a071aa service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:01.535806 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-6b18ed86-2c70-43ae-967a-cfc93346829b req-d205ca00-3d60-4ff1-affa-0b92e0a071aa service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:01.564424 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-6b18ed86-2c70-43ae-967a-cfc93346829b req-d205ca00-3d60-4ff1-affa-0b92e0a071aa service nova] Creating event network-vif-deleted:f0504a29-0f57-4b6a-b659-4d5559910b95 for instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 on hv-cinder-84067 May 09 23:11:01.571986 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-6b18ed86-2c70-43ae-967a-cfc93346829b req-d205ca00-3d60-4ff1-affa-0b92e0a071aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054669 May 09 23:11:01.578230 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 430/851] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:11:01.893845 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f890a5b2-ea73-4bd4-a7c7-0ccc33fbf8ab tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:01.896665 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f890a5b2-ea73-4bd4-a7c7-0ccc33fbf8ab tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:01.904161 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f890a5b2-ea73-4bd4-a7c7-0ccc33fbf8ab tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:01.904856 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f890a5b2-ea73-4bd4-a7c7-0ccc33fbf8ab tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:01.905990 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f890a5b2-ea73-4bd4-a7c7-0ccc33fbf8ab tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:01.906619 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f890a5b2-ea73-4bd4-a7c7-0ccc33fbf8ab tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:01.944128 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f890a5b2-ea73-4bd4-a7c7-0ccc33fbf8ab tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:01.944868 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f890a5b2-ea73-4bd4-a7c7-0ccc33fbf8ab tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:01.945690 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-f890a5b2-ea73-4bd4-a7c7-0ccc33fbf8ab tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lazy-loading 'fault' on Instance uuid 7e8552f4-9cab-423d-ae4f-6790f5de0f91 {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:11:01.997469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-f890a5b2-ea73-4bd4-a7c7-0ccc33fbf8ab tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:02.008539 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f890a5b2-ea73-4bd4-a7c7-0ccc33fbf8ab tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 200 len: 1326 microversion: 2.1 time: 0.121093 May 09 23:11:02.009127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 422/852] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:01 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 1326 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:03.027029 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-3a644a04-c72c-4d4f-aadc-fc58500545a1 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:03.027733 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-3a644a04-c72c-4d4f-aadc-fc58500545a1 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:03.034791 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3a644a04-c72c-4d4f-aadc-fc58500545a1 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:03.035246 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3a644a04-c72c-4d4f-aadc-fc58500545a1 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:03.036037 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3a644a04-c72c-4d4f-aadc-fc58500545a1 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:03.036468 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3a644a04-c72c-4d4f-aadc-fc58500545a1 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:03.052919 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-3a644a04-c72c-4d4f-aadc-fc58500545a1 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] HTTP exception thrown: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-3a644a04-c72c-4d4f-aadc-fc58500545a1 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Request method failure captured: May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 HTTP/1.1 May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ7Gr0UsiePwr5bYqC2-44u_h3QQAqcattlhUtpD60rlBpH4SiPyeIXQ0stOPxgdWkkZ8GJGSJMh2lnFnrAaf9lSUEUhB9I3yEcMCCTuCKNLEekcLWHFZ9wa9_MIay5KDeTtUfZKLpG1veE0w_Pig-fDjX8LAUbU7mvrpTVX9a4g2hE May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: c0df002b4f614f4bbac1782e1fbb484a May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-AttachVolumeTestJSON-6192396 May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:11:03.054689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:11:03.056129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:11:03.056129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-AttachVolumeTestJSON-6192396 May 09 23:11:03.056129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: c0df002b4f614f4bbac1782e1fbb484a May 09 23:11:03.056129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-AttachVolumeTestJSON-6192396 May 09 23:11:03.056129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-AttachVolumeTestJSON-6192396-project May 09 23:11:03.056129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:11:03.056129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:11:03.056129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 1de1f7ce5e5f4cfbb283f0c79d87f9c8 May 09 23:11:03.056129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-AttachVolumeTestJSON-6192396-project May 09 23:11:03.056129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:11:03.056129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:11:03.056129 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': '7e8552f4-9cab-423d-ae4f-6790f5de0f91'} May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:11:03.057579 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:11:03.058928 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:11:03.060119 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-3a644a04-c72c-4d4f-aadc-fc58500545a1 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Returning 404 to user: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:11:03.060119 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-3a644a04-c72c-4d4f-aadc-fc58500545a1 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 404 len: 111 microversion: 2.1 time: 0.033466 May 09 23:11:03.060119 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 431/853] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:03 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:11:03.066308 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e48daf8d-8457-445b-8929-ebc5bd931ccc tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '.version_select at 0x7fc28bade4c0>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:03.092042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e48daf8d-8457-445b-8929-ebc5bd931ccc tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-454659132" status: 202 len: 0 microversion: 2.1 time: 0.030421 May 09 23:11:03.092983 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 423/854] 10.222.0.23 () {58 vars in 1217 bytes} [Mon May 9 23:11:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-454659132 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:11:03.879093 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-43e7a515-0077-4a88-88e5-674d1e67892f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Action: 'create', calling method: .version_select at 0x7fc298177a60>, body: {"keypair": {"name": "tempest-keypair-441269321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIgtynRT9SakzPtGa/sN7gC8DqgobRrwNtmjY3LMp9tD6a+XASsDoSttKmzPQn5sKhyUhlF/4e72dfvXJcsr6j9Wdi/2p6gC6fP05c/a59N9cjlcmzJ6+kMoEyP0iScoA=="}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:11:03.895994 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-43e7a515-0077-4a88-88e5-674d1e67892f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Getting quotas for project c0df002b4f614f4bbac1782e1fbb484a. Resources: {'key_pairs'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:11:03.900066 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-43e7a515-0077-4a88-88e5-674d1e67892f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Getting quotas for user 1de1f7ce5e5f4cfbb283f0c79d87f9c8 and project c0df002b4f614f4bbac1782e1fbb484a. Resources: {'key_pairs'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:11:03.924205 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-43e7a515-0077-4a88-88e5-674d1e67892f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052452 May 09 23:11:03.925081 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 432/855] 10.222.0.23 () {60 vars in 1158 bytes} [Mon May 9 23:11:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:11:06.551217 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-473215907", "imageRef": "74d6f02e-f8f0-4365-8236-1bc7b47a3dcf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "585983fb-4a68-4b82-b675-7c4ec5efad6e"}], "security_groups": [{"name": "tempest-securitygroup--1215509395"}], "key_name": "tempest-keypair-441269321", "user_data": "}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:11:06.738849 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.network.neutron [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] validate_networks() for [('585983fb-4a68-4b82-b675-7c4ec5efad6e', None, None, None, None, None)] {{(pid=117142) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:11:07.660213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Flavor limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:11:07.661263 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Image limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:11:07.666594 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Flavor pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:11:07.668089 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Image pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:11:07.668684 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:11:07.679815 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:07.680583 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:07.681609 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:07.682519 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:07.717643 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Getting quotas for project c0df002b4f614f4bbac1782e1fbb484a. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:11:07.722231 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Getting quotas for user 1de1f7ce5e5f4cfbb283f0c79d87f9c8 and project c0df002b4f614f4bbac1782e1fbb484a. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:11:07.737943 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Going to run 1 instances... {{(pid=117142) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:11:07.741982 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d6f02e-f8f0-4365-8236-1bc7b47a3dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:11:07.800868 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f1381238-f7fd-471a-98be-5fecb5aefc3d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.253963 May 09 23:11:07.801768 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 424/856] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:11:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:11:07.811925 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b65c08f2-f416-451d-ac1e-91f28e381ea2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:07.813089 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b65c08f2-f416-451d-ac1e-91f28e381ea2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:07.916891 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b65c08f2-f416-451d-ac1e-91f28e381ea2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:07.926345 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b65c08f2-f416-451d-ac1e-91f28e381ea2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1236 microversion: 2.1 time: 0.117814 May 09 23:11:07.927403 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 433/857] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:07 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1236 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:08.949753 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-4917299a-4569-4f38-b50b-37894ea5a661 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:08.950511 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-4917299a-4569-4f38-b50b-37894ea5a661 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:08.957257 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4917299a-4569-4f38-b50b-37894ea5a661 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:08.957785 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4917299a-4569-4f38-b50b-37894ea5a661 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:08.958660 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4917299a-4569-4f38-b50b-37894ea5a661 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:08.959166 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-4917299a-4569-4f38-b50b-37894ea5a661 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:09.021947 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-4917299a-4569-4f38-b50b-37894ea5a661 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:09.033676 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-4917299a-4569-4f38-b50b-37894ea5a661 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1240 microversion: 2.1 time: 0.087591 May 09 23:11:09.034290 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 425/858] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:08 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:11:10.050486 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d4f7c7eb-ee47-4c16-a4f4-ae26db2d4c17 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:10.051755 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d4f7c7eb-ee47-4c16-a4f4-ae26db2d4c17 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:10.060176 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d4f7c7eb-ee47-4c16-a4f4-ae26db2d4c17 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:10.060857 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d4f7c7eb-ee47-4c16-a4f4-ae26db2d4c17 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:10.061638 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d4f7c7eb-ee47-4c16-a4f4-ae26db2d4c17 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:10.062975 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d4f7c7eb-ee47-4c16-a4f4-ae26db2d4c17 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:10.167401 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d4f7c7eb-ee47-4c16-a4f4-ae26db2d4c17 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:10.176365 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d4f7c7eb-ee47-4c16-a4f4-ae26db2d4c17 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1232 microversion: 2.1 time: 0.129716 May 09 23:11:10.176952 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 434/859] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:10 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1232 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:11.194379 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9f8bdbd7-ba5d-438c-bf8b-ad99af75389c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:11.195888 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9f8bdbd7-ba5d-438c-bf8b-ad99af75389c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:11.203273 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9f8bdbd7-ba5d-438c-bf8b-ad99af75389c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:11.204673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9f8bdbd7-ba5d-438c-bf8b-ad99af75389c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:11.205993 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9f8bdbd7-ba5d-438c-bf8b-ad99af75389c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:11.206648 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9f8bdbd7-ba5d-438c-bf8b-ad99af75389c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:11.309607 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-9f8bdbd7-ba5d-438c-bf8b-ad99af75389c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:11.327533 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9f8bdbd7-ba5d-438c-bf8b-ad99af75389c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1288 microversion: 2.1 time: 0.138381 May 09 23:11:11.348969 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 426/860] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:11 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1288 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:12.350879 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-dbbf1db5-62b3-47dd-bc6b-1594bdb3080c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:12.352159 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-dbbf1db5-62b3-47dd-bc6b-1594bdb3080c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:12.360069 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dbbf1db5-62b3-47dd-bc6b-1594bdb3080c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:12.360577 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dbbf1db5-62b3-47dd-bc6b-1594bdb3080c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:12.361385 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dbbf1db5-62b3-47dd-bc6b-1594bdb3080c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:12.361820 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dbbf1db5-62b3-47dd-bc6b-1594bdb3080c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:12.518064 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-dbbf1db5-62b3-47dd-bc6b-1594bdb3080c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:12.548106 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-dbbf1db5-62b3-47dd-bc6b-1594bdb3080c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1294 microversion: 2.1 time: 0.201115 May 09 23:11:12.558468 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 435/861] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:12 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1294 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:13.569796 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-05a59015-e90c-407a-945d-7eec7539a7b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:13.571362 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-05a59015-e90c-407a-945d-7eec7539a7b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:13.582545 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-05a59015-e90c-407a-945d-7eec7539a7b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:13.583338 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-05a59015-e90c-407a-945d-7eec7539a7b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:13.583780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-05a59015-e90c-407a-945d-7eec7539a7b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:13.584389 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-05a59015-e90c-407a-945d-7eec7539a7b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:13.694487 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-05a59015-e90c-407a-945d-7eec7539a7b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:13.706383 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-05a59015-e90c-407a-945d-7eec7539a7b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1294 microversion: 2.1 time: 0.139509 May 09 23:11:13.707710 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 427/862] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:13 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1294 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:14.724289 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-adda31f0-f91a-4144-bdc2-f4cf4f5d93c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:14.725022 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-adda31f0-f91a-4144-bdc2-f4cf4f5d93c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:14.735572 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-adda31f0-f91a-4144-bdc2-f4cf4f5d93c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:14.736158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-adda31f0-f91a-4144-bdc2-f4cf4f5d93c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:14.737186 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-adda31f0-f91a-4144-bdc2-f4cf4f5d93c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:14.737852 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-adda31f0-f91a-4144-bdc2-f4cf4f5d93c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:14.796303 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0fe265f8-14dd-4a42-9602-07be9a8483c2 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Action: 'create', calling method: .version_select at 0x7fc298159700>, body: {"keypair": {"name": "tempest-TestShelveInstance-707952866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExR8rWrBW/ZVkHMgSAAQ/7Fd2fifNBesuoODpdjL23iSQQLPa4Fvn5pQs6gQw8X4XZPnmD4kSPwQlVRtZ3efnecdmbLczxF0yCJtmYBBYwjyC5KJaVJyvNQNpNRfdlXbA=="}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:11:14.813117 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-adda31f0-f91a-4144-bdc2-f4cf4f5d93c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:14.821308 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-adda31f0-f91a-4144-bdc2-f4cf4f5d93c4 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1294 microversion: 2.1 time: 0.101439 May 09 23:11:14.825090 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-0fe265f8-14dd-4a42-9602-07be9a8483c2 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Getting quotas for project 130ce8965a764f6d8910c2bba4561534. Resources: {'key_pairs'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:11:14.830886 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-0fe265f8-14dd-4a42-9602-07be9a8483c2 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Getting quotas for user 4e2656d339a74bd882c2226251ac3d36 and project 130ce8965a764f6d8910c2bba4561534. Resources: {'key_pairs'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:11:14.831339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 428/863] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:14 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1294 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:14.855297 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-0fe265f8-14dd-4a42-9602-07be9a8483c2 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.260184 May 09 23:11:14.856075 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 436/864] 10.222.0.23 () {60 vars in 1158 bytes} [Mon May 9 23:11:14 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:11:15.840545 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-0a7fe8d4-26a8-43e9-9c68-f62694b2a1f6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:15.841527 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-0a7fe8d4-26a8-43e9-9c68-f62694b2a1f6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:15.853159 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0a7fe8d4-26a8-43e9-9c68-f62694b2a1f6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:15.854248 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0a7fe8d4-26a8-43e9-9c68-f62694b2a1f6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:15.855648 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0a7fe8d4-26a8-43e9-9c68-f62694b2a1f6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:15.856331 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-0a7fe8d4-26a8-43e9-9c68-f62694b2a1f6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:16.053210 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-0a7fe8d4-26a8-43e9-9c68-f62694b2a1f6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:16.064318 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-0a7fe8d4-26a8-43e9-9c68-f62694b2a1f6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1362 microversion: 2.1 time: 0.229465 May 09 23:11:16.064912 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 429/865] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:15 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:16.122492 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-c210ee7d-49c6-42c6-99d7-4af6c05cd3fe req-564e00a8-6447-4c67-afe1-91902acdc64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6995d5b2-6790-4cc9-b968-82e8b7890c71", "tag": "d8dd358c-7158-401a-abeb-8ab45dc5131b"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:11:16.132776 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-c210ee7d-49c6-42c6-99d7-4af6c05cd3fe req-564e00a8-6447-4c67-afe1-91902acdc64e service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:16.133429 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-c210ee7d-49c6-42c6-99d7-4af6c05cd3fe req-564e00a8-6447-4c67-afe1-91902acdc64e service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:16.162261 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-c210ee7d-49c6-42c6-99d7-4af6c05cd3fe req-564e00a8-6447-4c67-afe1-91902acdc64e service nova] Creating event network-changed:d8dd358c-7158-401a-abeb-8ab45dc5131b for instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 on hv-cinder-84067 May 09 23:11:16.175169 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-c210ee7d-49c6-42c6-99d7-4af6c05cd3fe req-564e00a8-6447-4c67-afe1-91902acdc64e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057217 May 09 23:11:16.176364 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 437/866] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:11:17.080976 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-b310c3ea-3337-4f6e-94fd-3de6d2156233 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:17.081433 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-b310c3ea-3337-4f6e-94fd-3de6d2156233 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:17.089132 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b310c3ea-3337-4f6e-94fd-3de6d2156233 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:17.089653 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b310c3ea-3337-4f6e-94fd-3de6d2156233 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:17.090695 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b310c3ea-3337-4f6e-94fd-3de6d2156233 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:17.091303 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-b310c3ea-3337-4f6e-94fd-3de6d2156233 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:17.244562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-b310c3ea-3337-4f6e-94fd-3de6d2156233 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:17.253270 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-b310c3ea-3337-4f6e-94fd-3de6d2156233 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1362 microversion: 2.1 time: 0.176522 May 09 23:11:17.253862 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 430/867] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:17 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:18.271646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-f51a06b2-e717-4af2-87a7-5d3433d8d28b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:18.272352 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-f51a06b2-e717-4af2-87a7-5d3433d8d28b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:18.278890 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f51a06b2-e717-4af2-87a7-5d3433d8d28b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:18.279339 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f51a06b2-e717-4af2-87a7-5d3433d8d28b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:18.280119 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f51a06b2-e717-4af2-87a7-5d3433d8d28b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:18.280812 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-f51a06b2-e717-4af2-87a7-5d3433d8d28b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:18.430451 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-f51a06b2-e717-4af2-87a7-5d3433d8d28b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:18.437812 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-f51a06b2-e717-4af2-87a7-5d3433d8d28b tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1362 microversion: 2.1 time: 0.170644 May 09 23:11:18.438410 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 438/868] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:18 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:19.455231 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-40ad1f30-3ada-4814-949b-d27d1a278552 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:19.455848 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-40ad1f30-3ada-4814-949b-d27d1a278552 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:19.462316 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-40ad1f30-3ada-4814-949b-d27d1a278552 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:19.463592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-40ad1f30-3ada-4814-949b-d27d1a278552 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:19.464512 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-40ad1f30-3ada-4814-949b-d27d1a278552 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:19.465146 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-40ad1f30-3ada-4814-949b-d27d1a278552 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:19.610892 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-40ad1f30-3ada-4814-949b-d27d1a278552 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:19.619096 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-40ad1f30-3ada-4814-949b-d27d1a278552 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1362 microversion: 2.1 time: 0.167573 May 09 23:11:19.619790 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 431/869] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:19 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:20.635680 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-9c545dd8-ea4b-45cb-a10c-0ece1ee04851 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:20.637306 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-9c545dd8-ea4b-45cb-a10c-0ece1ee04851 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:20.645785 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9c545dd8-ea4b-45cb-a10c-0ece1ee04851 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:20.646261 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9c545dd8-ea4b-45cb-a10c-0ece1ee04851 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:20.647042 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9c545dd8-ea4b-45cb-a10c-0ece1ee04851 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:20.647676 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9c545dd8-ea4b-45cb-a10c-0ece1ee04851 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:20.809171 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-9c545dd8-ea4b-45cb-a10c-0ece1ee04851 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:20.817424 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-9c545dd8-ea4b-45cb-a10c-0ece1ee04851 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1362 microversion: 2.1 time: 0.185533 May 09 23:11:20.818782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 439/870] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:20 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:21.835630 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-49f73021-4373-4cde-aedf-638545a16242 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:21.836167 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-49f73021-4373-4cde-aedf-638545a16242 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:21.842528 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-49f73021-4373-4cde-aedf-638545a16242 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:21.842974 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-49f73021-4373-4cde-aedf-638545a16242 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:21.843730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-49f73021-4373-4cde-aedf-638545a16242 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:21.844158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-49f73021-4373-4cde-aedf-638545a16242 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:21.976208 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-49f73021-4373-4cde-aedf-638545a16242 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:21.984464 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-49f73021-4373-4cde-aedf-638545a16242 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1362 microversion: 2.1 time: 0.152724 May 09 23:11:21.985068 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 432/871] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:21 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:22.505923 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-a27912e2-92c0-45dc-a039-6ef467e93a04 req-4397b00e-f010-46d4-b0d7-a4fe4684f982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6995d5b2-6790-4cc9-b968-82e8b7890c71", "name": "network-vif-plugged", "status": "completed", "tag": "d8dd358c-7158-401a-abeb-8ab45dc5131b"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:11:22.518514 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-a27912e2-92c0-45dc-a039-6ef467e93a04 req-4397b00e-f010-46d4-b0d7-a4fe4684f982 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:22.519251 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-a27912e2-92c0-45dc-a039-6ef467e93a04 req-4397b00e-f010-46d4-b0d7-a4fe4684f982 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:22.530487 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-a27912e2-92c0-45dc-a039-6ef467e93a04 req-4397b00e-f010-46d4-b0d7-a4fe4684f982 service nova] Creating event network-vif-plugged:d8dd358c-7158-401a-abeb-8ab45dc5131b for instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 on hv-cinder-84067 May 09 23:11:22.535613 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-a27912e2-92c0-45dc-a039-6ef467e93a04 req-4397b00e-f010-46d4-b0d7-a4fe4684f982 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034088 May 09 23:11:22.536748 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 440/872] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:11:23.001225 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e5b6cf68-5940-4a74-b4ac-0ce2dc4965f2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:23.001925 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e5b6cf68-5940-4a74-b4ac-0ce2dc4965f2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:23.008329 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e5b6cf68-5940-4a74-b4ac-0ce2dc4965f2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:23.008785 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e5b6cf68-5940-4a74-b4ac-0ce2dc4965f2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:23.009565 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e5b6cf68-5940-4a74-b4ac-0ce2dc4965f2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:23.010005 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e5b6cf68-5940-4a74-b4ac-0ce2dc4965f2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:23.138367 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e5b6cf68-5940-4a74-b4ac-0ce2dc4965f2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:23.145554 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e5b6cf68-5940-4a74-b4ac-0ce2dc4965f2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1362 microversion: 2.1 time: 0.148554 May 09 23:11:23.146137 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 433/873] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:22 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:24.163967 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d29fef19-dcb4-4bbe-901c-8f33871f3dd8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:24.164582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d29fef19-dcb4-4bbe-901c-8f33871f3dd8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:24.171613 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d29fef19-dcb4-4bbe-901c-8f33871f3dd8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:24.172066 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d29fef19-dcb4-4bbe-901c-8f33871f3dd8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:24.172834 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d29fef19-dcb4-4bbe-901c-8f33871f3dd8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:24.173275 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d29fef19-dcb4-4bbe-901c-8f33871f3dd8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:24.317767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d29fef19-dcb4-4bbe-901c-8f33871f3dd8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:24.325550 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d29fef19-dcb4-4bbe-901c-8f33871f3dd8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1548 microversion: 2.1 time: 0.165943 May 09 23:11:24.326150 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 441/874] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:24 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:24.361051 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-8b854b11-af83-46c0-b27e-6d158c962c3f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:24.361755 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-8b854b11-af83-46c0-b27e-6d158c962c3f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:24.368493 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8b854b11-af83-46c0-b27e-6d158c962c3f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:24.368951 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8b854b11-af83-46c0-b27e-6d158c962c3f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:24.369737 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8b854b11-af83-46c0-b27e-6d158c962c3f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:24.370321 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8b854b11-af83-46c0-b27e-6d158c962c3f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:24.449264 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-8b854b11-af83-46c0-b27e-6d158c962c3f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104781 May 09 23:11:24.449873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 434/875] 10.222.0.23 () {58 vars in 1274 bytes} [Mon May 9 23:11:24 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:11:25.717562 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-9a3d00bc-1ef5-480f-a533-945c4e642005 req-cd579331-194e-4c7a-b216-bcee01cd9e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6995d5b2-6790-4cc9-b968-82e8b7890c71", "tag": "d8dd358c-7158-401a-abeb-8ab45dc5131b"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:11:25.725894 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-9a3d00bc-1ef5-480f-a533-945c4e642005 req-cd579331-194e-4c7a-b216-bcee01cd9e1b service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:25.726475 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-9a3d00bc-1ef5-480f-a533-945c4e642005 req-cd579331-194e-4c7a-b216-bcee01cd9e1b service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:25.737320 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-9a3d00bc-1ef5-480f-a533-945c4e642005 req-cd579331-194e-4c7a-b216-bcee01cd9e1b service nova] Creating event network-changed:d8dd358c-7158-401a-abeb-8ab45dc5131b for instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 on hv-cinder-84067 May 09 23:11:25.742769 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-9a3d00bc-1ef5-480f-a533-945c4e642005 req-cd579331-194e-4c7a-b216-bcee01cd9e1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029364 May 09 23:11:25.743359 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 442/876] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:11:31.576645 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-166038206", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-707952866", "security_groups": [{"name": "tempest-secgroup-smoke-549799645"}], "networks": [{"uuid": "51deb12e-3ca1-4364-adad-de6d7141df3d"}], "block_device_mapping_v2": [{"uuid": "68303422-5b06-465d-b782-2d6fac3f9994", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:11:31.683418 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.network.neutron [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] validate_networks() for [('51deb12e-3ca1-4364-adad-de6d7141df3d', None, None, None, None, None)] {{(pid=117142) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:11:32.047197 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Flavor limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:11:32.047617 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Image limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:11:32.048086 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Flavor pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:11:32.048484 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Image pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:11:32.048887 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:11:32.057192 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:32.057638 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:32.058464 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:32.058893 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:32.074401 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Getting quotas for project 130ce8965a764f6d8910c2bba4561534. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:11:32.078000 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Getting quotas for user 4e2656d339a74bd882c2226251ac3d36 and project 130ce8965a764f6d8910c2bba4561534. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:11:32.132558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Going to run 1 instances... {{(pid=117142) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:11:32.134573 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68303422-5b06-465d-b782-2d6fac3f9994',volume_size=None,volume_type=None)] {{(pid=117142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:11:32.257285 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9bd52dc8-bd48-4d69-84d5-37ca0144f8e3 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.684927 May 09 23:11:32.257929 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 435/877] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:11:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:11:32.269097 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-041bb415-1213-446e-aa79-1261274de650 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:32.269804 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-041bb415-1213-446e-aa79-1261274de650 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:32.326886 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-041bb415-1213-446e-aa79-1261274de650 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:32.333574 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-041bb415-1213-446e-aa79-1261274de650 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1087 microversion: 2.1 time: 0.068977 May 09 23:11:32.334285 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 443/878] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:32 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1087 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:33.352805 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d376eb2b-4d45-4a3d-953c-22b37f5475ca tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:33.354366 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-d376eb2b-4d45-4a3d-953c-22b37f5475ca tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:33.360619 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d376eb2b-4d45-4a3d-953c-22b37f5475ca tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:33.361074 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d376eb2b-4d45-4a3d-953c-22b37f5475ca tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:33.361848 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d376eb2b-4d45-4a3d-953c-22b37f5475ca tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:33.362501 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d376eb2b-4d45-4a3d-953c-22b37f5475ca tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:33.423159 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-d376eb2b-4d45-4a3d-953c-22b37f5475ca tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:33.431073 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d376eb2b-4d45-4a3d-953c-22b37f5475ca tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1203 microversion: 2.1 time: 0.083588 May 09 23:11:33.432486 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 436/879] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:33 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1203 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:34.449780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-84c12704-0739-4bdf-9e1a-7aef57cf865e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:34.450439 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-84c12704-0739-4bdf-9e1a-7aef57cf865e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:34.458773 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84c12704-0739-4bdf-9e1a-7aef57cf865e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:34.459494 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84c12704-0739-4bdf-9e1a-7aef57cf865e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:34.461028 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84c12704-0739-4bdf-9e1a-7aef57cf865e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:34.461485 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-84c12704-0739-4bdf-9e1a-7aef57cf865e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:34.490919 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-f38a0ce2-7ec6-4c23-9240-0a259aa117c1 req-4fccae4d-d8f1-48cb-9b97-cb4aeca9fed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb54ad3-a0af-43eb-b93a-9dff50509eea", "tag": "b358901e-4e0b-4ec4-b3a8-96987f94191c"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:11:34.503493 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-f38a0ce2-7ec6-4c23-9240-0a259aa117c1 req-4fccae4d-d8f1-48cb-9b97-cb4aeca9fed5 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:34.504040 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-f38a0ce2-7ec6-4c23-9240-0a259aa117c1 req-4fccae4d-d8f1-48cb-9b97-cb4aeca9fed5 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:34.520494 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-f38a0ce2-7ec6-4c23-9240-0a259aa117c1 req-4fccae4d-d8f1-48cb-9b97-cb4aeca9fed5 service nova] Creating event network-changed:b358901e-4e0b-4ec4-b3a8-96987f94191c for instance 5fb54ad3-a0af-43eb-b93a-9dff50509eea on hv-cinder-84067 May 09 23:11:34.530358 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-f38a0ce2-7ec6-4c23-9240-0a259aa117c1 req-4fccae4d-d8f1-48cb-9b97-cb4aeca9fed5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050328 May 09 23:11:34.531304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 437/880] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:11:34.720379 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-84c12704-0739-4bdf-9e1a-7aef57cf865e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:34.727621 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-84c12704-0739-4bdf-9e1a-7aef57cf865e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1258 microversion: 2.1 time: 0.282610 May 09 23:11:34.728203 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 444/881] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:34 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1258 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:11:35.746170 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9910735b-4d93-4670-b9f4-0bd79ed65e81 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:35.746874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9910735b-4d93-4670-b9f4-0bd79ed65e81 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:35.752863 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9910735b-4d93-4670-b9f4-0bd79ed65e81 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:35.753310 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9910735b-4d93-4670-b9f4-0bd79ed65e81 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:35.754072 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9910735b-4d93-4670-b9f4-0bd79ed65e81 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:35.754595 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9910735b-4d93-4670-b9f4-0bd79ed65e81 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:35.884065 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-9910735b-4d93-4670-b9f4-0bd79ed65e81 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:35.892009 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9910735b-4d93-4670-b9f4-0bd79ed65e81 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1258 microversion: 2.1 time: 0.151033 May 09 23:11:35.892584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 438/882] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:35 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:36.908707 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-981f9ae8-5006-45ba-80e9-2ba98f7f5181 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:36.909251 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-981f9ae8-5006-45ba-80e9-2ba98f7f5181 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:36.915568 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-981f9ae8-5006-45ba-80e9-2ba98f7f5181 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:36.916026 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-981f9ae8-5006-45ba-80e9-2ba98f7f5181 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:36.917305 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-981f9ae8-5006-45ba-80e9-2ba98f7f5181 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:36.917743 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-981f9ae8-5006-45ba-80e9-2ba98f7f5181 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:37.048323 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-981f9ae8-5006-45ba-80e9-2ba98f7f5181 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:37.055530 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-981f9ae8-5006-45ba-80e9-2ba98f7f5181 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1258 microversion: 2.1 time: 0.150771 May 09 23:11:37.056275 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 445/883] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:36 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:38.073620 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5636be63-7dac-4a8a-b0b2-a20299d444ea tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:38.074375 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5636be63-7dac-4a8a-b0b2-a20299d444ea tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:38.080607 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5636be63-7dac-4a8a-b0b2-a20299d444ea tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:38.081054 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5636be63-7dac-4a8a-b0b2-a20299d444ea tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:38.081830 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5636be63-7dac-4a8a-b0b2-a20299d444ea tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:38.082288 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5636be63-7dac-4a8a-b0b2-a20299d444ea tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:38.213308 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5636be63-7dac-4a8a-b0b2-a20299d444ea tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:38.220965 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5636be63-7dac-4a8a-b0b2-a20299d444ea tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1258 microversion: 2.1 time: 0.151867 May 09 23:11:38.221621 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 439/884] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:38 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:39.239047 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c3dd1160-02f3-4230-8960-f8b8918ced3b tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:39.239654 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c3dd1160-02f3-4230-8960-f8b8918ced3b tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:39.246596 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c3dd1160-02f3-4230-8960-f8b8918ced3b tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:39.247036 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c3dd1160-02f3-4230-8960-f8b8918ced3b tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:39.247797 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c3dd1160-02f3-4230-8960-f8b8918ced3b tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:39.248226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c3dd1160-02f3-4230-8960-f8b8918ced3b tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:39.374099 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c3dd1160-02f3-4230-8960-f8b8918ced3b tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:39.381227 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c3dd1160-02f3-4230-8960-f8b8918ced3b tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1258 microversion: 2.1 time: 0.146065 May 09 23:11:39.381790 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 446/885] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:39 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1258 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:40.397682 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-874a80eb-8b19-4bc7-963f-62c356547da8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:40.398342 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-874a80eb-8b19-4bc7-963f-62c356547da8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:40.404688 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-874a80eb-8b19-4bc7-963f-62c356547da8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:40.405137 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-874a80eb-8b19-4bc7-963f-62c356547da8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:40.406243 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-874a80eb-8b19-4bc7-963f-62c356547da8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:40.406679 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-874a80eb-8b19-4bc7-963f-62c356547da8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:40.533392 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-874a80eb-8b19-4bc7-963f-62c356547da8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:40.540631 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-874a80eb-8b19-4bc7-963f-62c356547da8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1258 microversion: 2.1 time: 0.146657 May 09 23:11:40.541717 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 440/886] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:40 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:41.559951 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ec30baec-cfbe-4a5a-bb64-2d1954f72ae0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:41.560565 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ec30baec-cfbe-4a5a-bb64-2d1954f72ae0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:41.566957 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ec30baec-cfbe-4a5a-bb64-2d1954f72ae0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:41.567477 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ec30baec-cfbe-4a5a-bb64-2d1954f72ae0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:41.568263 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ec30baec-cfbe-4a5a-bb64-2d1954f72ae0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:41.568696 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ec30baec-cfbe-4a5a-bb64-2d1954f72ae0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:41.703268 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ec30baec-cfbe-4a5a-bb64-2d1954f72ae0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:41.710522 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ec30baec-cfbe-4a5a-bb64-2d1954f72ae0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1258 microversion: 2.1 time: 0.156556 May 09 23:11:41.711090 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 447/887] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:41 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:42.727581 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-89f8aa6a-3fa0-4785-a976-b2d8344dcd31 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:42.728145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-89f8aa6a-3fa0-4785-a976-b2d8344dcd31 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:42.734672 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-89f8aa6a-3fa0-4785-a976-b2d8344dcd31 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:42.735122 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-89f8aa6a-3fa0-4785-a976-b2d8344dcd31 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:42.735883 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-89f8aa6a-3fa0-4785-a976-b2d8344dcd31 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:42.736311 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-89f8aa6a-3fa0-4785-a976-b2d8344dcd31 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:42.867907 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-89f8aa6a-3fa0-4785-a976-b2d8344dcd31 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:42.877887 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-89f8aa6a-3fa0-4785-a976-b2d8344dcd31 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1258 microversion: 2.1 time: 0.153840 May 09 23:11:42.878775 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 441/888] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:42 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:43.895085 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-8b4c9452-69bd-45df-984f-3289ee24de15 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:43.895636 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-8b4c9452-69bd-45df-984f-3289ee24de15 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:43.902032 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8b4c9452-69bd-45df-984f-3289ee24de15 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:43.902513 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8b4c9452-69bd-45df-984f-3289ee24de15 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:43.903285 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8b4c9452-69bd-45df-984f-3289ee24de15 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:43.903712 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-8b4c9452-69bd-45df-984f-3289ee24de15 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:44.029625 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-8b4c9452-69bd-45df-984f-3289ee24de15 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:44.036851 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-8b4c9452-69bd-45df-984f-3289ee24de15 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1258 microversion: 2.1 time: 0.145709 May 09 23:11:44.037419 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 448/889] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:43 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1258 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:44.575076 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-79aed705-c68c-42cd-83ac-d02c5e08b9c5 req-de578f9b-eae6-434d-9d46-ff5abbc2a725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb54ad3-a0af-43eb-b93a-9dff50509eea", "name": "network-vif-plugged", "status": "completed", "tag": "b358901e-4e0b-4ec4-b3a8-96987f94191c"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:11:44.583512 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-79aed705-c68c-42cd-83ac-d02c5e08b9c5 req-de578f9b-eae6-434d-9d46-ff5abbc2a725 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:44.583977 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-79aed705-c68c-42cd-83ac-d02c5e08b9c5 req-de578f9b-eae6-434d-9d46-ff5abbc2a725 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:44.595480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-79aed705-c68c-42cd-83ac-d02c5e08b9c5 req-de578f9b-eae6-434d-9d46-ff5abbc2a725 service nova] Creating event network-vif-plugged:b358901e-4e0b-4ec4-b3a8-96987f94191c for instance 5fb54ad3-a0af-43eb-b93a-9dff50509eea on hv-cinder-84067 May 09 23:11:44.600380 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-79aed705-c68c-42cd-83ac-d02c5e08b9c5 req-de578f9b-eae6-434d-9d46-ff5abbc2a725 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029665 May 09 23:11:44.601130 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 442/890] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:11:45.052691 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-331b1e99-d2f3-4b50-b4f2-e4edbfceafbb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:45.053293 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-331b1e99-d2f3-4b50-b4f2-e4edbfceafbb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:45.059552 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-331b1e99-d2f3-4b50-b4f2-e4edbfceafbb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:45.059993 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-331b1e99-d2f3-4b50-b4f2-e4edbfceafbb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:45.060747 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-331b1e99-d2f3-4b50-b4f2-e4edbfceafbb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:45.061175 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-331b1e99-d2f3-4b50-b4f2-e4edbfceafbb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:45.187272 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-331b1e99-d2f3-4b50-b4f2-e4edbfceafbb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:45.194411 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-331b1e99-d2f3-4b50-b4f2-e4edbfceafbb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1258 microversion: 2.1 time: 0.145517 May 09 23:11:45.194953 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 449/891] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:45 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1258 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:46.213893 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e123932c-5e34-4977-b167-731f2f3ce044 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:46.214621 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e123932c-5e34-4977-b167-731f2f3ce044 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:46.221049 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e123932c-5e34-4977-b167-731f2f3ce044 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:46.221499 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e123932c-5e34-4977-b167-731f2f3ce044 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:46.222306 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e123932c-5e34-4977-b167-731f2f3ce044 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:46.222742 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-e123932c-5e34-4977-b167-731f2f3ce044 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:46.357247 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e123932c-5e34-4977-b167-731f2f3ce044 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:46.364517 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e123932c-5e34-4977-b167-731f2f3ce044 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1442 microversion: 2.1 time: 0.155977 May 09 23:11:46.365095 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 443/892] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:46 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:46.380271 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-daf0e627-eacb-47f5-b138-b15c814c1459 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:11:46.380923 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-daf0e627-eacb-47f5-b138-b15c814c1459 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:11:46.386891 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-daf0e627-eacb-47f5-b138-b15c814c1459 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:46.387345 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-daf0e627-eacb-47f5-b138-b15c814c1459 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:46.388118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-daf0e627-eacb-47f5-b138-b15c814c1459 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:46.388556 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-daf0e627-eacb-47f5-b138-b15c814c1459 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:46.513591 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-daf0e627-eacb-47f5-b138-b15c814c1459 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:11:46.520901 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-daf0e627-eacb-47f5-b138-b15c814c1459 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1442 microversion: 2.1 time: 0.144430 May 09 23:11:46.521469 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 450/893] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:11:46 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1442 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:11:48.484921 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-4da8a4bb-95bc-4153-9dec-ca43b2586633 req-6875f09b-e7d6-4ec7-9955-eb5e10f2da3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb54ad3-a0af-43eb-b93a-9dff50509eea", "tag": "b358901e-4e0b-4ec4-b3a8-96987f94191c"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:11:48.493184 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-4da8a4bb-95bc-4153-9dec-ca43b2586633 req-6875f09b-e7d6-4ec7-9955-eb5e10f2da3d service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:11:48.493631 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-4da8a4bb-95bc-4153-9dec-ca43b2586633 req-6875f09b-e7d6-4ec7-9955-eb5e10f2da3d service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:11:48.504463 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-4da8a4bb-95bc-4153-9dec-ca43b2586633 req-6875f09b-e7d6-4ec7-9955-eb5e10f2da3d service nova] Creating event network-changed:b358901e-4e0b-4ec4-b3a8-96987f94191c for instance 5fb54ad3-a0af-43eb-b93a-9dff50509eea on hv-cinder-84067 May 09 23:11:48.509350 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-4da8a4bb-95bc-4153-9dec-ca43b2586633 req-6875f09b-e7d6-4ec7-9955-eb5e10f2da3d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028129 May 09 23:11:48.510159 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 444/894] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:01.652877 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-70e5c26a-e66d-493c-bfff-4837b69f7aef tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:01.653376 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-70e5c26a-e66d-493c-bfff-4837b69f7aef tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:01.659776 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-70e5c26a-e66d-493c-bfff-4837b69f7aef tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:01.660226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-70e5c26a-e66d-493c-bfff-4837b69f7aef tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:01.660992 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-70e5c26a-e66d-493c-bfff-4837b69f7aef tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:01.661449 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-70e5c26a-e66d-493c-bfff-4837b69f7aef tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:01.684463 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-70e5c26a-e66d-493c-bfff-4837b69f7aef tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/ips" status: 200 len: 145 microversion: 2.1 time: 0.035444 May 09 23:12:01.685018 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 451/895] 10.222.0.23 () {58 vars in 1247 bytes} [Mon May 9 23:12:01 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:02.985174 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a15f9bb4-f268-4a42-a1ca-c69f084ac6cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07f89cca-7a08-4a56-9831-2eb8525a45e7"}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:12:02.986337 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a15f9bb4-f268-4a42-a1ca-c69f084ac6cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:02.992708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a15f9bb4-f268-4a42-a1ca-c69f084ac6cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:02.993150 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a15f9bb4-f268-4a42-a1ca-c69f084ac6cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:02.993901 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a15f9bb4-f268-4a42-a1ca-c69f084ac6cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:02.994369 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a15f9bb4-f268-4a42-a1ca-c69f084ac6cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:03.223221 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a15f9bb4-f268-4a42-a1ca-c69f084ac6cd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "POST /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242021 May 09 23:12:03.223809 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 445/896] 10.222.0.23 () {60 vars in 1322 bytes} [Mon May 9 23:12:02 2022] POST /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:09.642738 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1d6a7c83-e069-4f5c-945a-2a3f28628f70 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:09.643728 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1d6a7c83-e069-4f5c-945a-2a3f28628f70 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:09.650019 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1d6a7c83-e069-4f5c-945a-2a3f28628f70 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:09.650502 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1d6a7c83-e069-4f5c-945a-2a3f28628f70 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:09.651262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1d6a7c83-e069-4f5c-945a-2a3f28628f70 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:09.651700 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1d6a7c83-e069-4f5c-945a-2a3f28628f70 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:09.686386 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1d6a7c83-e069-4f5c-945a-2a3f28628f70 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046760 May 09 23:12:09.686865 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 452/897] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:12:09 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:09.697602 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-943c4016-0245-4fe8-9f36-35ac359fbe9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:09.698206 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-943c4016-0245-4fe8-9f36-35ac359fbe9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:09.704413 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-943c4016-0245-4fe8-9f36-35ac359fbe9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:09.704862 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-943c4016-0245-4fe8-9f36-35ac359fbe9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:09.705630 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-943c4016-0245-4fe8-9f36-35ac359fbe9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:09.706068 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-943c4016-0245-4fe8-9f36-35ac359fbe9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:09.734088 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-943c4016-0245-4fe8-9f36-35ac359fbe9a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments/07f89cca-7a08-4a56-9831-2eb8525a45e7" status: 200 len: 194 microversion: 2.1 time: 0.041257 May 09 23:12:09.734687 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 446/898] 10.222.0.23 () {58 vars in 1412 bytes} [Mon May 9 23:12:09 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments/07f89cca-7a08-4a56-9831-2eb8525a45e7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:11.033427 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-30f310ff-909d-4148-88e5-90e5380eefc2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c72eb8e-41bf-474f-b7e7-cbe51aac9255"}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:12:11.034507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-30f310ff-909d-4148-88e5-90e5380eefc2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:11.040714 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-30f310ff-909d-4148-88e5-90e5380eefc2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:11.041157 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-30f310ff-909d-4148-88e5-90e5380eefc2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:11.041910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-30f310ff-909d-4148-88e5-90e5380eefc2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:11.042365 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-30f310ff-909d-4148-88e5-90e5380eefc2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:11.269069 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-30f310ff-909d-4148-88e5-90e5380eefc2 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "POST /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240144 May 09 23:12:11.269692 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 453/899] 10.222.0.23 () {60 vars in 1322 bytes} [Mon May 9 23:12:11 2022] POST /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:18.747847 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-f93d08cb-2a60-4022-a756-914e8910b7fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:18.748771 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-f93d08cb-2a60-4022-a756-914e8910b7fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:18.755028 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f93d08cb-2a60-4022-a756-914e8910b7fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:18.755475 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f93d08cb-2a60-4022-a756-914e8910b7fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:18.756237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f93d08cb-2a60-4022-a756-914e8910b7fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:18.756676 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-f93d08cb-2a60-4022-a756-914e8910b7fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:18.786077 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-f93d08cb-2a60-4022-a756-914e8910b7fe tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042120 May 09 23:12:18.786648 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 447/900] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:12:18 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:18.929658 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d52d8bd1-7466-4255-8b2f-8839b7b0ee6d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:18.930251 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d52d8bd1-7466-4255-8b2f-8839b7b0ee6d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:18.936306 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d52d8bd1-7466-4255-8b2f-8839b7b0ee6d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:18.937126 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d52d8bd1-7466-4255-8b2f-8839b7b0ee6d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:18.938774 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d52d8bd1-7466-4255-8b2f-8839b7b0ee6d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:18.939387 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d52d8bd1-7466-4255-8b2f-8839b7b0ee6d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:18.970170 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d52d8bd1-7466-4255-8b2f-8839b7b0ee6d tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments/07f89cca-7a08-4a56-9831-2eb8525a45e7" status: 200 len: 194 microversion: 2.1 time: 0.045314 May 09 23:12:18.970753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 454/901] 10.222.0.23 () {58 vars in 1412 bytes} [Mon May 9 23:12:18 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments/07f89cca-7a08-4a56-9831-2eb8525a45e7 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:18.980484 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ce7cd83d-8a3c-487c-90cb-3f5bffb0d8a8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:18.980969 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ce7cd83d-8a3c-487c-90cb-3f5bffb0d8a8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:18.986896 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ce7cd83d-8a3c-487c-90cb-3f5bffb0d8a8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:18.987342 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ce7cd83d-8a3c-487c-90cb-3f5bffb0d8a8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:18.988094 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ce7cd83d-8a3c-487c-90cb-3f5bffb0d8a8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:18.988524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ce7cd83d-8a3c-487c-90cb-3f5bffb0d8a8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:19.065465 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-ce7cd83d-8a3c-487c-90cb-3f5bffb0d8a8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lazy-loading 'services' on Instance uuid 6995d5b2-6790-4cc9-b968-82e8b7890c71 {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:12:19.133480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ce7cd83d-8a3c-487c-90cb-3f5bffb0d8a8 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments/07f89cca-7a08-4a56-9831-2eb8525a45e7" status: 202 len: 0 microversion: 2.1 time: 0.157017 May 09 23:12:19.134061 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 448/902] 10.222.0.23 () {58 vars in 1415 bytes} [Mon May 9 23:12:18 2022] DELETE /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments/07f89cca-7a08-4a56-9831-2eb8525a45e7 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:12:20.240236 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ebe4166b-af47-4d14-a793-4c0bb045e0a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:20.240736 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ebe4166b-af47-4d14-a793-4c0bb045e0a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:20.246933 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ebe4166b-af47-4d14-a793-4c0bb045e0a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:20.247390 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ebe4166b-af47-4d14-a793-4c0bb045e0a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:20.248157 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ebe4166b-af47-4d14-a793-4c0bb045e0a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:20.248593 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ebe4166b-af47-4d14-a793-4c0bb045e0a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:20.276262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ebe4166b-af47-4d14-a793-4c0bb045e0a0 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments/1c72eb8e-41bf-474f-b7e7-cbe51aac9255" status: 200 len: 194 microversion: 2.1 time: 0.040037 May 09 23:12:20.276840 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 455/903] 10.222.0.23 () {58 vars in 1412 bytes} [Mon May 9 23:12:20 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments/1c72eb8e-41bf-474f-b7e7-cbe51aac9255 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:20.287868 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c1ab6ac9-5e25-4a57-a52c-21c5292787b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:20.288478 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c1ab6ac9-5e25-4a57-a52c-21c5292787b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:20.294572 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c1ab6ac9-5e25-4a57-a52c-21c5292787b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:20.295026 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c1ab6ac9-5e25-4a57-a52c-21c5292787b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:20.295796 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c1ab6ac9-5e25-4a57-a52c-21c5292787b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:20.296233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c1ab6ac9-5e25-4a57-a52c-21c5292787b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:20.373571 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-c1ab6ac9-5e25-4a57-a52c-21c5292787b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lazy-loading 'services' on Instance uuid 6995d5b2-6790-4cc9-b968-82e8b7890c71 {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:12:20.441984 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c1ab6ac9-5e25-4a57-a52c-21c5292787b6 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments/1c72eb8e-41bf-474f-b7e7-cbe51aac9255" status: 202 len: 0 microversion: 2.1 time: 0.158593 May 09 23:12:20.442662 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 449/904] 10.222.0.23 () {58 vars in 1415 bytes} [Mon May 9 23:12:20 2022] DELETE /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments/1c72eb8e-41bf-474f-b7e7-cbe51aac9255 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:12:21.602961 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-10a35f49-5608-4350-b867-b096314e5665 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:21.603886 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-10a35f49-5608-4350-b867-b096314e5665 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:21.610412 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-10a35f49-5608-4350-b867-b096314e5665 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:21.610863 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-10a35f49-5608-4350-b867-b096314e5665 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:21.611636 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-10a35f49-5608-4350-b867-b096314e5665 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:21.612073 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-10a35f49-5608-4350-b867-b096314e5665 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:21.640242 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-10a35f49-5608-4350-b867-b096314e5665 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041146 May 09 23:12:21.641315 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 456/905] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:12:21 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 23:12:21.745456 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d53629fc-9fa4-40dc-a320-6d1e2f59f911 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:21.746551 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-d53629fc-9fa4-40dc-a320-6d1e2f59f911 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:21.752829 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d53629fc-9fa4-40dc-a320-6d1e2f59f911 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:21.753200 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d53629fc-9fa4-40dc-a320-6d1e2f59f911 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:21.753960 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d53629fc-9fa4-40dc-a320-6d1e2f59f911 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:21.754419 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d53629fc-9fa4-40dc-a320-6d1e2f59f911 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:21.782369 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d53629fc-9fa4-40dc-a320-6d1e2f59f911 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041550 May 09 23:12:21.782917 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 450/906] 10.222.0.23 () {58 vars in 1301 bytes} [Mon May 9 23:12:21 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 23:12:21.837612 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a2916c0f-597d-4af7-b689-4c0e8dd8de05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:21.838128 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a2916c0f-597d-4af7-b689-4c0e8dd8de05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:21.844501 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a2916c0f-597d-4af7-b689-4c0e8dd8de05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:21.844955 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a2916c0f-597d-4af7-b689-4c0e8dd8de05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:21.845725 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a2916c0f-597d-4af7-b689-4c0e8dd8de05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:21.846216 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a2916c0f-597d-4af7-b689-4c0e8dd8de05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:21.872372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a2916c0f-597d-4af7-b689-4c0e8dd8de05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Going to try to terminate instance {{(pid=117143) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:12:21.945145 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a2916c0f-597d-4af7-b689-4c0e8dd8de05 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 204 len: 0 microversion: 2.1 time: 0.111121 May 09 23:12:21.945727 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 457/907] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:12:21 2022] DELETE /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:12:21.954766 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c8005e61-ab86-4a0f-af0a-03f37cea1cf3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:21.955376 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c8005e61-ab86-4a0f-af0a-03f37cea1cf3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:21.961174 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c8005e61-ab86-4a0f-af0a-03f37cea1cf3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:21.961624 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c8005e61-ab86-4a0f-af0a-03f37cea1cf3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:21.962422 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c8005e61-ab86-4a0f-af0a-03f37cea1cf3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:21.962855 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c8005e61-ab86-4a0f-af0a-03f37cea1cf3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:22.193922 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c8005e61-ab86-4a0f-af0a-03f37cea1cf3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:12:22.201178 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c8005e61-ab86-4a0f-af0a-03f37cea1cf3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1672 microversion: 2.1 time: 0.251060 May 09 23:12:22.201755 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 451/908] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:12:21 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1672 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:12:23.220299 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-93c44afa-d1d9-4f5b-a1f6-de3f49bb4808 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:23.220959 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-93c44afa-d1d9-4f5b-a1f6-de3f49bb4808 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:23.227171 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-93c44afa-d1d9-4f5b-a1f6-de3f49bb4808 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:23.227610 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-93c44afa-d1d9-4f5b-a1f6-de3f49bb4808 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:23.228365 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-93c44afa-d1d9-4f5b-a1f6-de3f49bb4808 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:23.228792 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-93c44afa-d1d9-4f5b-a1f6-de3f49bb4808 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:23.354398 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-93c44afa-d1d9-4f5b-a1f6-de3f49bb4808 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:12:23.361858 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-93c44afa-d1d9-4f5b-a1f6-de3f49bb4808 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1672 microversion: 2.1 time: 0.146457 May 09 23:12:23.362457 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 458/909] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:12:23 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:12:24.378943 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-dd0bc9c8-2e93-44a2-8ba4-eb8b6f718623 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:24.379635 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-dd0bc9c8-2e93-44a2-8ba4-eb8b6f718623 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:24.385947 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-dd0bc9c8-2e93-44a2-8ba4-eb8b6f718623 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:24.386511 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-dd0bc9c8-2e93-44a2-8ba4-eb8b6f718623 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:24.387338 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-dd0bc9c8-2e93-44a2-8ba4-eb8b6f718623 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:24.387834 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-dd0bc9c8-2e93-44a2-8ba4-eb8b6f718623 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:24.457536 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-dd0bc9c8-2e93-44a2-8ba4-eb8b6f718623 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:12:24.465912 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-dd0bc9c8-2e93-44a2-8ba4-eb8b6f718623 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1604 microversion: 2.1 time: 0.090688 May 09 23:12:24.468539 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 452/910] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:12:24 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1604 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:12:24.740897 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-ddd3625c-c86b-42b6-be34-124c0239f3d2 req-c6e0f248-7d64-4145-b556-40a112a89606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6995d5b2-6790-4cc9-b968-82e8b7890c71", "name": "network-vif-deleted", "tag": "d8dd358c-7158-401a-abeb-8ab45dc5131b"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:12:24.749148 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-ddd3625c-c86b-42b6-be34-124c0239f3d2 req-c6e0f248-7d64-4145-b556-40a112a89606 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:24.749596 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-ddd3625c-c86b-42b6-be34-124c0239f3d2 req-c6e0f248-7d64-4145-b556-40a112a89606 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:24.760291 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-ddd3625c-c86b-42b6-be34-124c0239f3d2 req-c6e0f248-7d64-4145-b556-40a112a89606 service nova] Creating event network-vif-deleted:d8dd358c-7158-401a-abeb-8ab45dc5131b for instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 on hv-cinder-84067 May 09 23:12:24.765228 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-ddd3625c-c86b-42b6-be34-124c0239f3d2 req-c6e0f248-7d64-4145-b556-40a112a89606 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027978 May 09 23:12:24.765824 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 459/911] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:25.484774 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5e741f6b-1cde-4546-ba13-883d2197f52a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:25.485894 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5e741f6b-1cde-4546-ba13-883d2197f52a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:25.492676 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5e741f6b-1cde-4546-ba13-883d2197f52a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:25.493132 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5e741f6b-1cde-4546-ba13-883d2197f52a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:25.493920 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5e741f6b-1cde-4546-ba13-883d2197f52a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:25.494393 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5e741f6b-1cde-4546-ba13-883d2197f52a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:25.527927 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5e741f6b-1cde-4546-ba13-883d2197f52a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:25.528521 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5e741f6b-1cde-4546-ba13-883d2197f52a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:25.529076 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-5e741f6b-1cde-4546-ba13-883d2197f52a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lazy-loading 'fault' on Instance uuid 6995d5b2-6790-4cc9-b968-82e8b7890c71 {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:12:25.574350 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5e741f6b-1cde-4546-ba13-883d2197f52a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1de1f7ce5e5f4cfbb283f0c79d87f9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0df002b4f614f4bbac1782e1fbb484a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:12:25.594625 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5e741f6b-1cde-4546-ba13-883d2197f52a tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 200 len: 1326 microversion: 2.1 time: 0.114526 May 09 23:12:25.595230 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 453/912] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:12:25 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 1326 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:12:26.613515 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b4232f27-2bb3-43fa-9dfe-1d53325032bd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:26.614252 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b4232f27-2bb3-43fa-9dfe-1d53325032bd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:26.620344 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b4232f27-2bb3-43fa-9dfe-1d53325032bd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:26.620790 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b4232f27-2bb3-43fa-9dfe-1d53325032bd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:26.621586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b4232f27-2bb3-43fa-9dfe-1d53325032bd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:26.622022 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b4232f27-2bb3-43fa-9dfe-1d53325032bd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:26.634984 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-b4232f27-2bb3-43fa-9dfe-1d53325032bd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] HTTP exception thrown: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b4232f27-2bb3-43fa-9dfe-1d53325032bd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Request method failure captured: May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 HTTP/1.1 May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ7Gr0UsiePwr5bYqC2-44u_h3QQAqcattlhUtpD60rlBpH4SiPyeIXQ0stOPxgdWkkZ8GJGSJMh2lnFnrAaf9lSUEUhB9I3yEcMCCTuCKNLEekcLWHFZ9wa9_MIay5KDeTtUfZKLpG1veE0w_Pig-fDjX8LAUbU7mvrpTVX9a4g2hE May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: c0df002b4f614f4bbac1782e1fbb484a May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:12:26.636602 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:12:26.638092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:26.638092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:26.638092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: c0df002b4f614f4bbac1782e1fbb484a May 09 23:12:26.638092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:26.638092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-AttachVolumeTestJSON-6192396-project May 09 23:12:26.638092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:12:26.638092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:12:26.638092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 1de1f7ce5e5f4cfbb283f0c79d87f9c8 May 09 23:12:26.638092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-AttachVolumeTestJSON-6192396-project May 09 23:12:26.638092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:12:26.638092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:26.638092 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': '6995d5b2-6790-4cc9-b968-82e8b7890c71'} May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:26.638995 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:26.640571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:26.642166 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b4232f27-2bb3-43fa-9dfe-1d53325032bd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Returning 404 to user: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:26.642166 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b4232f27-2bb3-43fa-9dfe-1d53325032bd tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 404 len: 111 microversion: 2.1 time: 0.029719 May 09 23:12:26.642166 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 460/913] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:12:26 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 23:12:26.646672 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ad216cb5-aba4-41c3-84d3-b3376c8f947c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '.version_select at 0x7fc28b955c10>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:26.663627 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ad216cb5-aba4-41c3-84d3-b3376c8f947c tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-441269321" status: 202 len: 0 microversion: 2.1 time: 0.020637 May 09 23:12:26.664179 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 454/914] 10.222.0.23 () {58 vars in 1217 bytes} [Mon May 9 23:12:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-441269321 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 23:12:29.531610 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-dc40be75-00e2-49dd-abbd-35fedaaee0e3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:29.532611 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-dc40be75-00e2-49dd-abbd-35fedaaee0e3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:29.538935 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dc40be75-00e2-49dd-abbd-35fedaaee0e3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:29.539384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dc40be75-00e2-49dd-abbd-35fedaaee0e3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:29.540153 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dc40be75-00e2-49dd-abbd-35fedaaee0e3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:29.540590 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dc40be75-00e2-49dd-abbd-35fedaaee0e3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:29.554248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-dc40be75-00e2-49dd-abbd-35fedaaee0e3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] HTTP exception thrown: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-dc40be75-00e2-49dd-abbd-35fedaaee0e3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Request method failure captured: May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: DELETE /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 HTTP/1.1 May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ7Gr0UsiePwr5bYqC2-44u_h3QQAqcattlhUtpD60rlBpH4SiPyeIXQ0stOPxgdWkkZ8GJGSJMh2lnFnrAaf9lSUEUhB9I3yEcMCCTuCKNLEekcLWHFZ9wa9_MIay5KDeTtUfZKLpG1veE0w_Pig-fDjX8LAUbU7mvrpTVX9a4g2hE May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: c0df002b4f614f4bbac1782e1fbb484a May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:12:29.555766 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:12:29.557204 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:29.557204 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:29.557204 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: c0df002b4f614f4bbac1782e1fbb484a May 09 23:12:29.557204 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:29.557204 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-AttachVolumeTestJSON-6192396-project May 09 23:12:29.557204 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:12:29.557204 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:12:29.557204 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 1de1f7ce5e5f4cfbb283f0c79d87f9c8 May 09 23:12:29.557204 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-AttachVolumeTestJSON-6192396-project May 09 23:12:29.557204 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:12:29.557204 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:29.557204 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': '6995d5b2-6790-4cc9-b968-82e8b7890c71'} May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:29.557976 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:29.559254 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:29.560483 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-dc40be75-00e2-49dd-abbd-35fedaaee0e3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Returning 404 to user: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:29.560483 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-dc40be75-00e2-49dd-abbd-35fedaaee0e3 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 404 len: 111 microversion: 2.1 time: 0.029441 May 09 23:12:29.560483 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 461/915] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:12:29 2022] DELETE /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:12:29.565799 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c9b78eb1-f011-4651-8259-919bf057231f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:29.566455 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c9b78eb1-f011-4651-8259-919bf057231f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 6995d5b2-6790-4cc9-b968-82e8b7890c71] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:29.572777 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c9b78eb1-f011-4651-8259-919bf057231f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:29.573211 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c9b78eb1-f011-4651-8259-919bf057231f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:29.573972 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c9b78eb1-f011-4651-8259-919bf057231f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:29.574425 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c9b78eb1-f011-4651-8259-919bf057231f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:29.587318 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-c9b78eb1-f011-4651-8259-919bf057231f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] HTTP exception thrown: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c9b78eb1-f011-4651-8259-919bf057231f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Request method failure captured: May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 HTTP/1.1 May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ7Gr0UsiePwr5bYqC2-44u_h3QQAqcattlhUtpD60rlBpH4SiPyeIXQ0stOPxgdWkkZ8GJGSJMh2lnFnrAaf9lSUEUhB9I3yEcMCCTuCKNLEekcLWHFZ9wa9_MIay5KDeTtUfZKLpG1veE0w_Pig-fDjX8LAUbU7mvrpTVX9a4g2hE May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: c0df002b4f614f4bbac1782e1fbb484a May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:12:29.588940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:12:29.590611 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:29.590611 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:29.590611 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: c0df002b4f614f4bbac1782e1fbb484a May 09 23:12:29.590611 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:29.590611 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-AttachVolumeTestJSON-6192396-project May 09 23:12:29.590611 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:12:29.590611 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:12:29.590611 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 1de1f7ce5e5f4cfbb283f0c79d87f9c8 May 09 23:12:29.590611 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-AttachVolumeTestJSON-6192396-project May 09 23:12:29.590611 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:12:29.590611 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:29.590611 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '6995d5b2-6790-4cc9-b968-82e8b7890c71'} May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:29.591524 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. May 09 23:12:29.593098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:29.595002 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c9b78eb1-f011-4651-8259-919bf057231f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Returning 404 to user: Instance 6995d5b2-6790-4cc9-b968-82e8b7890c71 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:29.595002 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c9b78eb1-f011-4651-8259-919bf057231f tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71" status: 404 len: 111 microversion: 2.1 time: 0.028852 May 09 23:12:29.595002 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 455/916] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:12:29 2022] GET /compute/v2.1/servers/6995d5b2-6790-4cc9-b968-82e8b7890c71 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:12:30.724801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1e65a34c-7537-4275-a1ad-0ea0a2485649 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:30.725305 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-1e65a34c-7537-4275-a1ad-0ea0a2485649 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:30.731753 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1e65a34c-7537-4275-a1ad-0ea0a2485649 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:30.732211 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1e65a34c-7537-4275-a1ad-0ea0a2485649 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:30.732975 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1e65a34c-7537-4275-a1ad-0ea0a2485649 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:30.733410 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-1e65a34c-7537-4275-a1ad-0ea0a2485649 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:30.746836 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-1e65a34c-7537-4275-a1ad-0ea0a2485649 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] HTTP exception thrown: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1e65a34c-7537-4275-a1ad-0ea0a2485649 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Request method failure captured: May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: DELETE /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 HTTP/1.1 May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ7Gr0UsiePwr5bYqC2-44u_h3QQAqcattlhUtpD60rlBpH4SiPyeIXQ0stOPxgdWkkZ8GJGSJMh2lnFnrAaf9lSUEUhB9I3yEcMCCTuCKNLEekcLWHFZ9wa9_MIay5KDeTtUfZKLpG1veE0w_Pig-fDjX8LAUbU7mvrpTVX9a4g2hE May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: c0df002b4f614f4bbac1782e1fbb484a May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:12:30.748362 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:12:30.749767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:30.749767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:30.749767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: c0df002b4f614f4bbac1782e1fbb484a May 09 23:12:30.749767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:30.749767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-AttachVolumeTestJSON-6192396-project May 09 23:12:30.749767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:12:30.749767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:12:30.749767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 1de1f7ce5e5f4cfbb283f0c79d87f9c8 May 09 23:12:30.749767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-AttachVolumeTestJSON-6192396-project May 09 23:12:30.749767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:12:30.749767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:12:30.749767 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': '7e8552f4-9cab-423d-ae4f-6790f5de0f91'} May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:30.750549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:12:30.752058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:30.754133 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1e65a34c-7537-4275-a1ad-0ea0a2485649 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Returning 404 to user: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:30.754133 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1e65a34c-7537-4275-a1ad-0ea0a2485649 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 404 len: 111 microversion: 2.1 time: 0.028800 May 09 23:12:30.754133 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 462/917] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:12:30 2022] DELETE /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:12:30.758715 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fd3ddc7a-2f87-43e6-add6-529de34e1017 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:30.759327 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-fd3ddc7a-2f87-43e6-add6-529de34e1017 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] [instance: 7e8552f4-9cab-423d-ae4f-6790f5de0f91] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:12:30.765337 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fd3ddc7a-2f87-43e6-add6-529de34e1017 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:30.765786 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fd3ddc7a-2f87-43e6-add6-529de34e1017 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:30.766691 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fd3ddc7a-2f87-43e6-add6-529de34e1017 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:12:30.767121 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fd3ddc7a-2f87-43e6-add6-529de34e1017 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:12:30.780266 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-fd3ddc7a-2f87-43e6-add6-529de34e1017 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] HTTP exception thrown: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fd3ddc7a-2f87-43e6-add6-529de34e1017 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Request method failure captured: May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 HTTP/1.1 May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ7Gr0UsiePwr5bYqC2-44u_h3QQAqcattlhUtpD60rlBpH4SiPyeIXQ0stOPxgdWkkZ8GJGSJMh2lnFnrAaf9lSUEUhB9I3yEcMCCTuCKNLEekcLWHFZ9wa9_MIay5KDeTtUfZKLpG1veE0w_Pig-fDjX8LAUbU7mvrpTVX9a4g2hE May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: c0df002b4f614f4bbac1782e1fbb484a May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:12:30.781761 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:12:30.783440 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c0df002b4f614f4bbac1782e1fbb484a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:30.783440 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:30.783440 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: c0df002b4f614f4bbac1782e1fbb484a May 09 23:12:30.783440 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-AttachVolumeTestJSON-6192396 May 09 23:12:30.783440 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-AttachVolumeTestJSON-6192396-project May 09 23:12:30.783440 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:12:30.783440 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:12:30.783440 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 1de1f7ce5e5f4cfbb283f0c79d87f9c8 May 09 23:12:30.783440 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-AttachVolumeTestJSON-6192396-project May 09 23:12:30.783440 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:12:30.783440 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:12:30.783440 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '7e8552f4-9cab-423d-ae4f-6790f5de0f91'} May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:30.784244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. May 09 23:12:30.785429 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:30.786581 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fd3ddc7a-2f87-43e6-add6-529de34e1017 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] Returning 404 to user: Instance 7e8552f4-9cab-423d-ae4f-6790f5de0f91 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:30.786581 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-fd3ddc7a-2f87-43e6-add6-529de34e1017 tempest-AttachVolumeTestJSON-6192396 tempest-AttachVolumeTestJSON-6192396-project] 10.222.0.23 "GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91" status: 404 len: 111 microversion: 2.1 time: 0.028249 May 09 23:12:30.786581 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 456/918] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:12:30 2022] GET /compute/v2.1/servers/7e8552f4-9cab-423d-ae4f-6790f5de0f91 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 23:12:34.785140 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d69ee29e-b899-4424-a3b8-b33e57ed8124 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Action: 'create', calling method: .version_select at 0x7fc2981af3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1594628711"}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:12:35.154411 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d69ee29e-b899-4424-a3b8-b33e57ed8124 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.478280 May 09 23:12:35.155057 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 463/919] 10.222.0.23 () {60 vars in 1154 bytes} [Mon May 9 23:12:34 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 480 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 09 23:12:35.167018 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-6f5f3740-1e5e-4c90-8dcb-b3bebcf2f3c0 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc28b9780d0>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:35.216785 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-6f5f3740-1e5e-4c90-8dcb-b3bebcf2f3c0 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059" status: 200 len: 345 microversion: 2.1 time: 0.054035 May 09 23:12:35.217402 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 457/920] 10.222.0.23 () {58 vars in 1244 bytes} [Mon May 9 23:12:35 2022] GET /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:36.230648 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5f6c56a1-7fe9-4499-9653-e69dfef1784d tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc298177ca0>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:36.276364 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-5f6c56a1-7fe9-4499-9653-e69dfef1784d tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059" status: 200 len: 346 microversion: 2.1 time: 0.050251 May 09 23:12:36.276918 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 464/921] 10.222.0.23 () {58 vars in 1244 bytes} [Mon May 9 23:12:36 2022] GET /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:36.288256 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d9f9a729-d584-4f00-9077-1f271d42e166 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Action: 'create', calling method: .version_select at 0x7fc28b94a310>, body: {"snapshot": {"volume_id": "f9421cc2-22a9-43c9-9e6b-7e2a260cb059", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-18435020"}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:12:36.427899 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d9f9a729-d584-4f00-9077-1f271d42e166 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.143818 May 09 23:12:36.428492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 458/922] 10.222.0.23 () {60 vars in 1161 bytes} [Mon May 9 23:12:36 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:36.439194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-602b38fa-e509-4867-9a2d-6f010c0bdba5 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc2980b2040>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:36.469718 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-602b38fa-e509-4867-9a2d-6f010c0bdba5 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3" status: 200 len: 285 microversion: 2.1 time: 0.035193 May 09 23:12:36.470541 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 465/923] 10.222.0.23 () {58 vars in 1250 bytes} [Mon May 9 23:12:36 2022] GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:12:36.480531 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-82871103-2591-4876-976b-12ec0052b2a6 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc28b9e7c10>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:36.511288 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-82871103-2591-4876-976b-12ec0052b2a6 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.034764 May 09 23:12:36.511850 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 459/924] 10.222.0.23 () {58 vars in 1139 bytes} [Mon May 9 23:12:36 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:36.521509 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-53ecab1b-666d-456a-98fc-8d929a16963f tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc29807dee0>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:36.549690 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-53ecab1b-666d-456a-98fc-8d929a16963f tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3" status: 200 len: 285 microversion: 2.1 time: 0.031883 May 09 23:12:36.550287 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 466/925] 10.222.0.23 () {58 vars in 1250 bytes} [Mon May 9 23:12:36 2022] GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:37.561690 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-45e72454-a146-4e33-8ba4-360a8843a448 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc28ba93280>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:37.591005 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-45e72454-a146-4e33-8ba4-360a8843a448 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3" status: 200 len: 285 microversion: 2.1 time: 0.033507 May 09 23:12:37.591609 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 460/926] 10.222.0.23 () {58 vars in 1250 bytes} [Mon May 9 23:12:37 2022] GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:38.211917 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:12:38.212479 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Mon May 9 23:12:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 23:12:38.603486 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-8d64f54c-0c26-4932-a067-be3a7334f3fa tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc29807dee0>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:38.632430 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-8d64f54c-0c26-4932-a067-be3a7334f3fa tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3" status: 200 len: 285 microversion: 2.1 time: 0.033549 May 09 23:12:38.633020 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 467/927] 10.222.0.23 () {58 vars in 1250 bytes} [Mon May 9 23:12:38 2022] GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:39.643939 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-b4e86d3b-7506-4ccc-a279-d77e7ebdbf8e tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc28b978040>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:39.672898 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-b4e86d3b-7506-4ccc-a279-d77e7ebdbf8e tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3" status: 200 len: 286 microversion: 2.1 time: 0.032671 May 09 23:12:39.673452 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 461/928] 10.222.0.23 () {58 vars in 1250 bytes} [Mon May 9 23:12:39 2022] GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:39.683748 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ff91667a-de97-4624-9d6d-2a2811309721 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc2981af160>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:39.739365 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ff91667a-de97-4624-9d6d-2a2811309721 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3" status: 202 len: 0 microversion: 2.1 time: 0.059739 May 09 23:12:39.740021 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 468/929] 10.222.0.23 () {58 vars in 1253 bytes} [Mon May 9 23:12:39 2022] DELETE /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:12:39.748095 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a1ede26e-0bf4-4c19-a473-13dfd38f468d tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc28ba93af0>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:39.776854 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a1ede26e-0bf4-4c19-a473-13dfd38f468d tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3" status: 200 len: 285 microversion: 2.1 time: 0.032531 May 09 23:12:39.777407 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 462/930] 10.222.0.23 () {58 vars in 1250 bytes} [Mon May 9 23:12:39 2022] GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:40.788643 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d8254fad-0742-4e5d-94b8-a084c296a715 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc29819bca0>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:40.812643 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-d8254fad-0742-4e5d-94b8-a084c296a715 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] HTTP exception thrown: Snapshot 65543d22-564c-48de-856e-c1dcb205abd3 could not be found. May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d8254fad-0742-4e5d-94b8-a084c296a715 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Request method failure captured: May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3 HTTP/1.1 May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ_iLadmAiIoM95WfYQAZHJAV2eVAvs7gQ4oyINcajUr1zjIWp-R8Vus1TnHuS2YTmOok26iuIMsYCVdb5j6Jam1MzgcyryOJLYmKvG2sEkIZ-rFn4PYvpS-MF4KsoldszNH8bL2oh-SrOIvgj3tR7y36RY-c8rS3sgFY1uH1eMhAw8 May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 393d9067cef543b5ad23dc37a24f0ae5 May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1648290373 May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:12:40.824499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:12:40.826167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:40.826167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1648290373 May 09 23:12:40.826167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 393d9067cef543b5ad23dc37a24f0ae5 May 09 23:12:40.826167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1648290373 May 09 23:12:40.826167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-VolumesSnapshotsTestJSON-1648290373-project May 09 23:12:40.826167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:12:40.826167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:12:40.826167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: e17437ea6d3b44ebbcdcbeb4b6666ad7 May 09 23:12:40.826167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1648290373-project May 09 23:12:40.826167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: May 09 23:12:40.826167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Snapshot 65543d22-564c-48de-856e-c1dcb205abd3 could not be found. May 09 23:12:40.826167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': '65543d22-564c-48de-856e-c1dcb205abd3'} May 09 23:12:40.826167 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 65543d22-564c-48de-856e-c1dcb205abd3 could not be found. (HTTP 404) (Request-ID: req-1e8cc033-a37b-4de7-bfb3-7191d8d1fc23) May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:40.827067 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 23:12:40.828258 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 65543d22-564c-48de-856e-c1dcb205abd3 could not be found. May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 09 23:12:40.829503 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:12:40.830968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 65543d22-564c-48de-856e-c1dcb205abd3 could not be found. May 09 23:12:40.830968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:40.830968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:40.830968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:40.830968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:40.830968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:40.830968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:40.830968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:12:40.830968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:12:40.830968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 65543d22-564c-48de-856e-c1dcb205abd3 could not be found. May 09 23:12:40.830968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:40.830968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d8254fad-0742-4e5d-94b8-a084c296a715 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Returning 404 to user: Snapshot 65543d22-564c-48de-856e-c1dcb205abd3 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:40.830968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d8254fad-0742-4e5d-94b8-a084c296a715 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3" status: 404 len: 111 microversion: 2.1 time: 0.041531 May 09 23:12:40.832000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 469/931] 10.222.0.23 () {58 vars in 1250 bytes} [Mon May 9 23:12:40 2022] GET /compute/v2.1/os-snapshots/65543d22-564c-48de-856e-c1dcb205abd3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:12:40.835312 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a682e146-7ee3-42e7-8f5b-55e61a165ac4 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc28b9e99d0>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:40.897379 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a682e146-7ee3-42e7-8f5b-55e61a165ac4 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059" status: 202 len: 0 microversion: 2.1 time: 0.065037 May 09 23:12:40.897379 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 463/932] 10.222.0.23 () {58 vars in 1247 bytes} [Mon May 9 23:12:40 2022] DELETE /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:12:40.905056 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-4f7046b7-eb23-44d5-98b1-721fa26db594 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc29819b8b0>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:40.953305 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-4f7046b7-eb23-44d5-98b1-721fa26db594 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059" status: 200 len: 345 microversion: 2.1 time: 0.052157 May 09 23:12:40.953925 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 470/933] 10.222.0.23 () {58 vars in 1244 bytes} [Mon May 9 23:12:40 2022] GET /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:41.966517 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1d1dbd3f-167b-4517-abcc-3b814652e099 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc28b978e50>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:41.993178 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-1d1dbd3f-167b-4517-abcc-3b814652e099 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] HTTP exception thrown: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1d1dbd3f-167b-4517-abcc-3b814652e099 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Request method failure captured: May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059 HTTP/1.1 May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ_iLadmAiIoM95WfYQAZHJAV2eVAvs7gQ4oyINcajUr1zjIWp-R8Vus1TnHuS2YTmOok26iuIMsYCVdb5j6Jam1MzgcyryOJLYmKvG2sEkIZ-rFn4PYvpS-MF4KsoldszNH8bL2oh-SrOIvgj3tR7y36RY-c8rS3sgFY1uH1eMhAw8 May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: 393d9067cef543b5ad23dc37a24f0ae5 May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1648290373 May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:12:41.996412 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:12:41.998042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:41.998042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1648290373 May 09 23:12:41.998042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: 393d9067cef543b5ad23dc37a24f0ae5 May 09 23:12:41.998042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1648290373 May 09 23:12:41.998042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-VolumesSnapshotsTestJSON-1648290373-project May 09 23:12:41.998042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:12:41.998042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:12:41.998042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: e17437ea6d3b44ebbcdcbeb4b6666ad7 May 09 23:12:41.998042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1648290373-project May 09 23:12:41.998042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: May 09 23:12:41.998042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:41.998042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': 'f9421cc2-22a9-43c9-9e6b-7e2a260cb059'} May 09 23:12:41.998042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. (HTTP 404) (Request-ID: req-f5250c1e-6039-4584-ab74-5c61e892770d) May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:41.999110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 23:12:42.000339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 23:12:42.002145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:12:42.003673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:42.003673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:42.003673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:42.003673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:42.003673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:42.003673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:42.003673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:42.003673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:12:42.003673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:12:42.003673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:42.003673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:42.003673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1d1dbd3f-167b-4517-abcc-3b814652e099 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Returning 404 to user: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:42.003673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1d1dbd3f-167b-4517-abcc-3b814652e099 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059" status: 404 len: 109 microversion: 2.1 time: 0.035749 May 09 23:12:42.003673 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 464/934] 10.222.0.23 () {58 vars in 1244 bytes} [Mon May 9 23:12:41 2022] GET /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:12:42.008681 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1c943cf4-f91b-49de-a0b5-24ed4e5ed261 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc2982ba3a0>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:42.035186 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-1c943cf4-f91b-49de-a0b5-24ed4e5ed261 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] HTTP exception thrown: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1c943cf4-f91b-49de-a0b5-24ed4e5ed261 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Request method failure captured: May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: DELETE /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059 HTTP/1.1 May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ_iLadmAiIoM95WfYQAZHJAV2eVAvs7gQ4oyINcajUr1zjIWp-R8Vus1TnHuS2YTmOok26iuIMsYCVdb5j6Jam1MzgcyryOJLYmKvG2sEkIZ-rFn4PYvpS-MF4KsoldszNH8bL2oh-SrOIvgj3tR7y36RY-c8rS3sgFY1uH1eMhAw8 May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 393d9067cef543b5ad23dc37a24f0ae5 May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1648290373 May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:12:42.037407 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:12:42.039024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:42.039024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1648290373 May 09 23:12:42.039024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 393d9067cef543b5ad23dc37a24f0ae5 May 09 23:12:42.039024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1648290373 May 09 23:12:42.039024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-VolumesSnapshotsTestJSON-1648290373-project May 09 23:12:42.039024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:12:42.039024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:12:42.039024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: e17437ea6d3b44ebbcdcbeb4b6666ad7 May 09 23:12:42.039024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1648290373-project May 09 23:12:42.039024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: May 09 23:12:42.039024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:42.039024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': 'f9421cc2-22a9-43c9-9e6b-7e2a260cb059'} May 09 23:12:42.039024 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. (HTTP 404) (Request-ID: req-e4572b65-fb3a-42e4-9e43-edada6fab3cf) May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:42.039990 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 23:12:42.041158 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 23:12:42.042349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:12:42.043801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:42.043801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:42.043801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:42.043801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:42.043801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:42.043801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:42.043801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:42.043801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:12:42.043801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:12:42.043801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:42.043801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:42.043801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1c943cf4-f91b-49de-a0b5-24ed4e5ed261 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Returning 404 to user: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:42.043801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1c943cf4-f91b-49de-a0b5-24ed4e5ed261 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059" status: 404 len: 109 microversion: 2.1 time: 0.034364 May 09 23:12:42.043801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 471/935] 10.222.0.23 () {58 vars in 1247 bytes} [Mon May 9 23:12:42 2022] DELETE /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 23:12:42.047866 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c03d4f7f-75b1-4c67-be0a-1cb76c58f7f9 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Calling method '.version_select at 0x7fc28b978af0>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:42.074640 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-c03d4f7f-75b1-4c67-be0a-1cb76c58f7f9 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] HTTP exception thrown: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c03d4f7f-75b1-4c67-be0a-1cb76c58f7f9 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Request method failure captured: May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059 HTTP/1.1 May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ_iLadmAiIoM95WfYQAZHJAV2eVAvs7gQ4oyINcajUr1zjIWp-R8Vus1TnHuS2YTmOok26iuIMsYCVdb5j6Jam1MzgcyryOJLYmKvG2sEkIZ-rFn4PYvpS-MF4KsoldszNH8bL2oh-SrOIvgj3tR7y36RY-c8rS3sgFY1uH1eMhAw8 May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: 393d9067cef543b5ad23dc37a24f0ae5 May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1648290373 May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:12:42.076567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:12:42.078158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/393d9067cef543b5ad23dc37a24f0ae5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:42.078158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1648290373 May 09 23:12:42.078158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: 393d9067cef543b5ad23dc37a24f0ae5 May 09 23:12:42.078158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1648290373 May 09 23:12:42.078158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-VolumesSnapshotsTestJSON-1648290373-project May 09 23:12:42.078158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:12:42.078158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:12:42.078158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: e17437ea6d3b44ebbcdcbeb4b6666ad7 May 09 23:12:42.078158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1648290373-project May 09 23:12:42.078158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: May 09 23:12:42.078158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:42.078158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': 'f9421cc2-22a9-43c9-9e6b-7e2a260cb059'} May 09 23:12:42.078158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. (HTTP 404) (Request-ID: req-def3c9cf-399b-468a-a101-22fd54c4c613) May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:42.079282 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 23:12:42.080453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 23:12:42.082204 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:12:42.083558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:42.083558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:42.083558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:42.083558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:42.083558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:42.083558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:42.083558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:42.083558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:12:42.083558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:12:42.083558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. May 09 23:12:42.083558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:42.083558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c03d4f7f-75b1-4c67-be0a-1cb76c58f7f9 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] Returning 404 to user: Volume f9421cc2-22a9-43c9-9e6b-7e2a260cb059 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:42.083558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c03d4f7f-75b1-4c67-be0a-1cb76c58f7f9 tempest-VolumesSnapshotsTestJSON-1648290373 tempest-VolumesSnapshotsTestJSON-1648290373-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059" status: 404 len: 109 microversion: 2.1 time: 0.034685 May 09 23:12:42.083558 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 465/936] 10.222.0.23 () {58 vars in 1244 bytes} [Mon May 9 23:12:42 2022] GET /compute/v2.1/os-volumes/f9421cc2-22a9-43c9-9e6b-7e2a260cb059 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:12:43.393353 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d6a98618-0704-4b38-9de8-d2861aa88081 tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] Action: 'create', calling method: .version_select at 0x7fc2983969d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1259545951", "metadata": {"Type": "work"}}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:12:43.681323 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d6a98618-0704-4b38-9de8-d2861aa88081 tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.399729 May 09 23:12:43.681950 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 472/937] 10.222.0.23 () {60 vars in 1155 bytes} [Mon May 9 23:12:43 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 401 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 09 23:12:43.693968 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-93025903-d6cd-4d8f-a813-2ac9821df06c tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] Calling method '.version_select at 0x7fc28ba0c310>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:43.744574 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-93025903-d6cd-4d8f-a813-2ac9821df06c tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7a23e556-a4dc-4350-8833-29e600ff22f5" status: 200 len: 353 microversion: 2.1 time: 0.054901 May 09 23:12:43.745302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 466/938] 10.222.0.23 () {58 vars in 1244 bytes} [Mon May 9 23:12:43 2022] GET /compute/v2.1/os-volumes/7a23e556-a4dc-4350-8833-29e600ff22f5 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:44.760785 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-dde77691-0ae2-48e2-9a3e-2aa59c4282ef tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] Calling method '.version_select at 0x7fc29833b040>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:44.806350 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-dde77691-0ae2-48e2-9a3e-2aa59c4282ef tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7a23e556-a4dc-4350-8833-29e600ff22f5" status: 200 len: 354 microversion: 2.1 time: 0.052340 May 09 23:12:44.806929 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 473/939] 10.222.0.23 () {58 vars in 1244 bytes} [Mon May 9 23:12:44 2022] GET /compute/v2.1/os-volumes/7a23e556-a4dc-4350-8833-29e600ff22f5 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:44.818652 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-4e0e06e2-f757-437d-a470-a39cb8d17a04 tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] Calling method '.version_select at 0x7fc28b9e7d30>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:44.865684 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-4e0e06e2-f757-437d-a470-a39cb8d17a04 tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7a23e556-a4dc-4350-8833-29e600ff22f5" status: 200 len: 354 microversion: 2.1 time: 0.051315 May 09 23:12:44.866283 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 467/940] 10.222.0.23 () {58 vars in 1244 bytes} [Mon May 9 23:12:44 2022] GET /compute/v2.1/os-volumes/7a23e556-a4dc-4350-8833-29e600ff22f5 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:44.877868 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ec0b343d-1e4c-4a69-a04c-f284107f97bb tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] Calling method '.version_select at 0x7fc298396dc0>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:44.934993 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ec0b343d-1e4c-4a69-a04c-f284107f97bb tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/7a23e556-a4dc-4350-8833-29e600ff22f5" status: 202 len: 0 microversion: 2.1 time: 0.060929 May 09 23:12:44.935559 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 474/941] 10.222.0.23 () {58 vars in 1247 bytes} [Mon May 9 23:12:44 2022] DELETE /compute/v2.1/os-volumes/7a23e556-a4dc-4350-8833-29e600ff22f5 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:12:44.943548 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-167f170c-d1a8-47f9-9575-5c1d3f337ed6 tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] Calling method '.version_select at 0x7fc28b9af5e0>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:44.990487 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-167f170c-d1a8-47f9-9575-5c1d3f337ed6 tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7a23e556-a4dc-4350-8833-29e600ff22f5" status: 200 len: 353 microversion: 2.1 time: 0.050703 May 09 23:12:44.991087 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 468/942] 10.222.0.23 () {58 vars in 1244 bytes} [Mon May 9 23:12:44 2022] GET /compute/v2.1/os-volumes/7a23e556-a4dc-4350-8833-29e600ff22f5 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:12:46.003765 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5e1ae2ac-e98c-4d1f-93a2-287601f09772 tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] Calling method '.version_select at 0x7fc29818f5e0>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:46.030297 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-5e1ae2ac-e98c-4d1f-93a2-287601f09772 tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] HTTP exception thrown: Volume 7a23e556-a4dc-4350-8833-29e600ff22f5 could not be found. May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5e1ae2ac-e98c-4d1f-93a2-287601f09772 tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] Request method failure captured: May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/os-volumes/7a23e556-a4dc-4350-8833-29e600ff22f5 HTTP/1.1 May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ_r7sNJ6bd6ZYrNh6j7mkthCRSLbP3TLJzvJ0n2MHsbGupFH8fS-oAtVeo0J4y8UkdDn5ByEsfgxZiOvrF4TId863CZ6t0axbxwAB-Akv1Fh6pmtU6MOzAJ_euq8VYkGFFp5Rf5P2jW5bIgpzpQP10r2fsMz_U8d-fSkc_vUVD4EpQ May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 3a940ddf496a432ca64efb0a01280aed May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-VolumesGetTestJSON-295951395 May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:12:46.032226 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:12:46.033780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3a940ddf496a432ca64efb0a01280aed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3a940ddf496a432ca64efb0a01280aed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3a940ddf496a432ca64efb0a01280aed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3a940ddf496a432ca64efb0a01280aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:46.033780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-VolumesGetTestJSON-295951395 May 09 23:12:46.033780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 3a940ddf496a432ca64efb0a01280aed May 09 23:12:46.033780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-VolumesGetTestJSON-295951395 May 09 23:12:46.033780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-VolumesGetTestJSON-295951395-project May 09 23:12:46.033780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:12:46.033780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:12:46.033780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: c10fb91235c6458b88815ac7a5904637 May 09 23:12:46.033780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-VolumesGetTestJSON-295951395-project May 09 23:12:46.033780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: May 09 23:12:46.033780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Volume 7a23e556-a4dc-4350-8833-29e600ff22f5 could not be found. May 09 23:12:46.033780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': '7a23e556-a4dc-4350-8833-29e600ff22f5'} May 09 23:12:46.033780 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a23e556-a4dc-4350-8833-29e600ff22f5 could not be found. (HTTP 404) (Request-ID: req-336f75ea-8cdd-4f4f-bd40-2f51eec26e75) May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:46.034816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 23:12:46.036248 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a23e556-a4dc-4350-8833-29e600ff22f5 could not be found. May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 23:12:46.037534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:12:46.038970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a23e556-a4dc-4350-8833-29e600ff22f5 could not be found. May 09 23:12:46.038970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:46.038970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:46.038970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:46.038970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:46.038970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:46.038970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:46.038970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:12:46.038970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:12:46.038970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a23e556-a4dc-4350-8833-29e600ff22f5 could not be found. May 09 23:12:46.038970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:46.038970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5e1ae2ac-e98c-4d1f-93a2-287601f09772 tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] Returning 404 to user: Volume 7a23e556-a4dc-4350-8833-29e600ff22f5 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:46.038970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-5e1ae2ac-e98c-4d1f-93a2-287601f09772 tempest-VolumesGetTestJSON-295951395 tempest-VolumesGetTestJSON-295951395-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7a23e556-a4dc-4350-8833-29e600ff22f5" status: 404 len: 109 microversion: 2.1 time: 0.034694 May 09 23:12:46.038970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 475/943] 10.222.0.23 () {58 vars in 1244 bytes} [Mon May 9 23:12:45 2022] GET /compute/v2.1/os-volumes/7a23e556-a4dc-4350-8833-29e600ff22f5 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:12:47.351349 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-2bf61c36-9403-468a-9083-acabb344cdcc tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Action: 'create', calling method: .version_select at 0x7fc28b9dc4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1468217040", "metadata": {"Type": "work"}}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-2bf61c36-9403-468a-9083-acabb344cdcc tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Request method failure captured: May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 122 May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ_v7o0e1CJ6MKRpEdSceRgU7mISnxb4Xswa7PD9cVSz9NWH4sqbRFZ8jKwHDmFHYFnbH9rvMsAZd4XSO4BRLi0KGlTBKA6NaajJrwY-77Mzx1mqvsPhkfP6nYOVtCW7oKRY0yXFXft11cIasd-2ZUrbj14_mDhX_hg1aKPERgphKWU May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: 91d8f714d9ef4fecad2300b79b4cf1c3 May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:12:47.361874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:12:47.363469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:47.363469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.363469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: 91d8f714d9ef4fecad2300b79b4cf1c3 May 09 23:12:47.363469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.363469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-VolumesNegativeTest-1871494438-project May 09 23:12:47.363469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:12:47.363469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:12:47.363469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 0e792f156e7b483ebd1dacc6882e6303 May 09 23:12:47.363469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-VolumesNegativeTest-1871494438-project May 09 23:12:47.363469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: May 09 23:12:47.363469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1468217040", "metadata": {"Type": "work"}}} May 09 23:12:47.363469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: May 09 23:12:47.363469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1468217040', 'metadata': {'Type': 'work'}}}} May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise error May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi '#$%' May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:47.364588 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 23:12:47.366359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 23:12:47.368111 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 23:12:47.368111 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.368111 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-2bf61c36-9403-468a-9083-acabb344cdcc tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:47.368111 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-2bf61c36-9403-468a-9083-acabb344cdcc tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.121664 May 09 23:12:47.368111 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 469/944] 10.222.0.23 () {60 vars in 1155 bytes} [Mon May 9 23:12:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 23:12:47.373875 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0ca40aa7-4b3c-422b-8ab4-d6e07ac931bf tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Action: 'create', calling method: .version_select at 0x7fc29818ff70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1334538742", "metadata": {"Type": "work"}}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0ca40aa7-4b3c-422b-8ab4-d6e07ac931bf tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Request method failure captured: May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 120 May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ_v7o0e1CJ6MKRpEdSceRgU7mISnxb4Xswa7PD9cVSz9NWH4sqbRFZ8jKwHDmFHYFnbH9rvMsAZd4XSO4BRLi0KGlTBKA6NaajJrwY-77Mzx1mqvsPhkfP6nYOVtCW7oKRY0yXFXft11cIasd-2ZUrbj14_mDhX_hg1aKPERgphKWU May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 91d8f714d9ef4fecad2300b79b4cf1c3 May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:12:47.377586 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:12:47.379138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:47.379138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.379138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 91d8f714d9ef4fecad2300b79b4cf1c3 May 09 23:12:47.379138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.379138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-VolumesNegativeTest-1871494438-project May 09 23:12:47.379138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:12:47.379138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:12:47.379138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 0e792f156e7b483ebd1dacc6882e6303 May 09 23:12:47.379138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-VolumesNegativeTest-1871494438-project May 09 23:12:47.379138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: May 09 23:12:47.379138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1334538742", "metadata": {"Type": "work"}}} May 09 23:12:47.379138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: May 09 23:12:47.379138 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1334538742', 'metadata': {'Type': 'work'}}}} May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise error May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi '0' May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:47.380234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 23:12:47.381835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 23:12:47.383497 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 23:12:47.383497 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.383497 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0ca40aa7-4b3c-422b-8ab4-d6e07ac931bf tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:47.383497 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-0ca40aa7-4b3c-422b-8ab4-d6e07ac931bf tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009989 May 09 23:12:47.383497 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 476/945] 10.222.0.23 () {60 vars in 1155 bytes} [Mon May 9 23:12:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 23:12:47.387590 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-71dd8578-4f88-4a8f-a9cc-e18dddb6a454 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Action: 'create', calling method: .version_select at 0x7fc28b95c5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1070212309", "metadata": {"Type": "work"}}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-71dd8578-4f88-4a8f-a9cc-e18dddb6a454 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Request method failure captured: May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 119 May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ_v7o0e1CJ6MKRpEdSceRgU7mISnxb4Xswa7PD9cVSz9NWH4sqbRFZ8jKwHDmFHYFnbH9rvMsAZd4XSO4BRLi0KGlTBKA6NaajJrwY-77Mzx1mqvsPhkfP6nYOVtCW7oKRY0yXFXft11cIasd-2ZUrbj14_mDhX_hg1aKPERgphKWU May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: 91d8f714d9ef4fecad2300b79b4cf1c3 May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:12:47.389838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:12:47.392021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:47.392021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.392021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: 91d8f714d9ef4fecad2300b79b4cf1c3 May 09 23:12:47.392021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.392021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-VolumesNegativeTest-1871494438-project May 09 23:12:47.392021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:12:47.392021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:12:47.392021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 0e792f156e7b483ebd1dacc6882e6303 May 09 23:12:47.392021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-VolumesNegativeTest-1871494438-project May 09 23:12:47.392021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: May 09 23:12:47.392021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1070212309", "metadata": {"Type": "work"}}} May 09 23:12:47.392021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: May 09 23:12:47.392021 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1070212309', 'metadata': {'Type': 'work'}}}} May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise error May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi '' May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:47.393067 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 23:12:47.394754 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 23:12:47.396261 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 23:12:47.396261 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.396261 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-71dd8578-4f88-4a8f-a9cc-e18dddb6a454 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:47.396261 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-71dd8578-4f88-4a8f-a9cc-e18dddb6a454 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007300 May 09 23:12:47.396261 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 470/946] 10.222.0.23 () {60 vars in 1155 bytes} [Mon May 9 23:12:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 09 23:12:47.400300 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a82785c7-d4fc-4f53-b258-1bc3c7c3a9b0 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Calling method '.version_select at 0x7fc29833b040>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:47.426217 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-a82785c7-d4fc-4f53-b258-1bc3c7c3a9b0 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] HTTP exception thrown: Volume tempest-invalid-468662251 could not be found. May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a82785c7-d4fc-4f53-b258-1bc3c7c3a9b0 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Request method failure captured: May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-468662251 HTTP/1.1 May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ_v7o0e1CJ6MKRpEdSceRgU7mISnxb4Xswa7PD9cVSz9NWH4sqbRFZ8jKwHDmFHYFnbH9rvMsAZd4XSO4BRLi0KGlTBKA6NaajJrwY-77Mzx1mqvsPhkfP6nYOVtCW7oKRY0yXFXft11cIasd-2ZUrbj14_mDhX_hg1aKPERgphKWU May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 91d8f714d9ef4fecad2300b79b4cf1c3 May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:12:47.428098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:12:47.429653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:47.429653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.429653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 91d8f714d9ef4fecad2300b79b4cf1c3 May 09 23:12:47.429653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.429653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-VolumesNegativeTest-1871494438-project May 09 23:12:47.429653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:12:47.429653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:12:47.429653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 0e792f156e7b483ebd1dacc6882e6303 May 09 23:12:47.429653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-VolumesNegativeTest-1871494438-project May 09 23:12:47.429653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: May 09 23:12:47.429653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Volume tempest-invalid-468662251 could not be found. May 09 23:12:47.429653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': 'tempest-invalid-468662251'} May 09 23:12:47.429653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-468662251 could not be found. (HTTP 404) (Request-ID: req-ee8e44cd-7806-414e-9f86-e6ef8bfcf401) May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.430649 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 23:12:47.431782 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-468662251 could not be found. May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:12:47.432945 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-468662251 could not be found. May 09 23:12:47.434220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.434220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.434220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.434220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.434220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:47.434220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:47.434220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:12:47.434220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:12:47.434220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-468662251 could not be found. May 09 23:12:47.434220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.434220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a82785c7-d4fc-4f53-b258-1bc3c7c3a9b0 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Returning 404 to user: Volume tempest-invalid-468662251 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:47.434220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a82785c7-d4fc-4f53-b258-1bc3c7c3a9b0 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-468662251" status: 404 len: 98 microversion: 2.1 time: 0.032733 May 09 23:12:47.434220 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 477/947] 10.222.0.23 () {58 vars in 1214 bytes} [Mon May 9 23:12:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-468662251 => generated 98 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 09 23:12:47.439298 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-86009059-d59b-46d1-9bbf-02068dc14456 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004400 May 09 23:12:47.439797 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 471/948] 10.222.0.23 () {58 vars in 1139 bytes} [Mon May 9 23:12:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 09 23:12:47.448444 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-191ea356-437a-44fe-ae03-1b1d61cbf7ba tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004406 May 09 23:12:47.448963 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 478/949] 10.222.0.23 () {58 vars in 1136 bytes} [Mon May 9 23:12:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 09 23:12:47.457868 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-657da462-dced-4d92-8308-805d31084219 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Calling method '.version_select at 0x7fc28ba0cd30>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:47.485180 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-657da462-dced-4d92-8308-805d31084219 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] HTTP exception thrown: Volume be14c6fa-d3bc-410a-8e65-f19d5f37e7f1 could not be found. May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-657da462-dced-4d92-8308-805d31084219 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Request method failure captured: May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: DELETE /compute/v2.1/os-volumes/be14c6fa-d3bc-410a-8e65-f19d5f37e7f1 HTTP/1.1 May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ_v7o0e1CJ6MKRpEdSceRgU7mISnxb4Xswa7PD9cVSz9NWH4sqbRFZ8jKwHDmFHYFnbH9rvMsAZd4XSO4BRLi0KGlTBKA6NaajJrwY-77Mzx1mqvsPhkfP6nYOVtCW7oKRY0yXFXft11cIasd-2ZUrbj14_mDhX_hg1aKPERgphKWU May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: 91d8f714d9ef4fecad2300b79b4cf1c3 May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:12:47.487157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:12:47.488730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:47.488730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.488730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: 91d8f714d9ef4fecad2300b79b4cf1c3 May 09 23:12:47.488730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.488730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-VolumesNegativeTest-1871494438-project May 09 23:12:47.488730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:12:47.488730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:12:47.488730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 0e792f156e7b483ebd1dacc6882e6303 May 09 23:12:47.488730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-VolumesNegativeTest-1871494438-project May 09 23:12:47.488730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: May 09 23:12:47.488730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Volume be14c6fa-d3bc-410a-8e65-f19d5f37e7f1 could not be found. May 09 23:12:47.488730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': 'be14c6fa-d3bc-410a-8e65-f19d5f37e7f1'} May 09 23:12:47.488730 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be14c6fa-d3bc-410a-8e65-f19d5f37e7f1 could not be found. (HTTP 404) (Request-ID: req-ad9e3b79-40b6-4705-b7aa-d3692f67dff1) May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.489781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 23:12:47.491265 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be14c6fa-d3bc-410a-8e65-f19d5f37e7f1 could not be found. May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 23:12:47.492706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:12:47.494165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume be14c6fa-d3bc-410a-8e65-f19d5f37e7f1 could not be found. May 09 23:12:47.494165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.494165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.494165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.494165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.494165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:47.494165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:47.494165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:12:47.494165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:12:47.494165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be14c6fa-d3bc-410a-8e65-f19d5f37e7f1 could not be found. May 09 23:12:47.494165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:12:47.494165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-657da462-dced-4d92-8308-805d31084219 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Returning 404 to user: Volume be14c6fa-d3bc-410a-8e65-f19d5f37e7f1 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:47.494165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-657da462-dced-4d92-8308-805d31084219 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/be14c6fa-d3bc-410a-8e65-f19d5f37e7f1" status: 404 len: 109 microversion: 2.1 time: 0.034854 May 09 23:12:47.494165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 472/950] 10.222.0.23 () {58 vars in 1247 bytes} [Mon May 9 23:12:47 2022] DELETE /compute/v2.1/os-volumes/be14c6fa-d3bc-410a-8e65-f19d5f37e7f1 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:12:47.499986 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ef0fb963-6338-4e5f-8d19-789c195eb0a3 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Calling method '.version_select at 0x7fc29833bdc0>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:12:47.526499 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-ef0fb963-6338-4e5f-8d19-789c195eb0a3 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] HTTP exception thrown: Volume ad18c148-8e77-447f-93a2-366a0adce024 could not be found. May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ef0fb963-6338-4e5f-8d19-789c195eb0a3 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Request method failure captured: May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: GET /compute/v2.1/os-volumes/ad18c148-8e77-447f-93a2-366a0adce024 HTTP/1.1 May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieZ_v7o0e1CJ6MKRpEdSceRgU7mISnxb4Xswa7PD9cVSz9NWH4sqbRFZ8jKwHDmFHYFnbH9rvMsAZd4XSO4BRLi0KGlTBKA6NaajJrwY-77Mzx1mqvsPhkfP6nYOVtCW7oKRY0yXFXft11cIasd-2ZUrbj14_mDhX_hg1aKPERgphKWU May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: 91d8f714d9ef4fecad2300b79b4cf1c3 May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:12:47.528456 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:12:47.530083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91d8f714d9ef4fecad2300b79b4cf1c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:12:47.530083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.530083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: 91d8f714d9ef4fecad2300b79b4cf1c3 May 09 23:12:47.530083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-VolumesNegativeTest-1871494438 May 09 23:12:47.530083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-VolumesNegativeTest-1871494438-project May 09 23:12:47.530083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:12:47.530083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:12:47.530083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 0e792f156e7b483ebd1dacc6882e6303 May 09 23:12:47.530083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-VolumesNegativeTest-1871494438-project May 09 23:12:47.530083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: May 09 23:12:47.530083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Volume ad18c148-8e77-447f-93a2-366a0adce024 could not be found. May 09 23:12:47.530083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': 'ad18c148-8e77-447f-93a2-366a0adce024'} May 09 23:12:47.530083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad18c148-8e77-447f-93a2-366a0adce024 could not be found. (HTTP 404) (Request-ID: req-a489e5d0-b4ae-45b9-88b4-ea08ed413c2d) May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.530998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 23:12:47.532428 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad18c148-8e77-447f-93a2-366a0adce024 could not be found. May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 23:12:47.533573 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:12:47.534759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad18c148-8e77-447f-93a2-366a0adce024 could not be found. May 09 23:12:47.534759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.534759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:12:47.534759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.534759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:12:47.534759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:12:47.534759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:12:47.534759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:12:47.534759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:12:47.534759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad18c148-8e77-447f-93a2-366a0adce024 could not be found. May 09 23:12:47.534759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:12:47.534759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ef0fb963-6338-4e5f-8d19-789c195eb0a3 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] Returning 404 to user: Volume ad18c148-8e77-447f-93a2-366a0adce024 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:12:47.534759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ef0fb963-6338-4e5f-8d19-789c195eb0a3 tempest-VolumesNegativeTest-1871494438 tempest-VolumesNegativeTest-1871494438-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ad18c148-8e77-447f-93a2-366a0adce024" status: 404 len: 109 microversion: 2.1 time: 0.033555 May 09 23:12:47.534759 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 479/951] 10.222.0.23 () {58 vars in 1244 bytes} [Mon May 9 23:12:47 2022] GET /compute/v2.1/os-volumes/ad18c148-8e77-447f-93a2-366a0adce024 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:13:45.840752 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d4cfabd2-82b2-4e32-b20f-2b6fa1338c87 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:13:45.841376 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-d4cfabd2-82b2-4e32-b20f-2b6fa1338c87 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:45.847228 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d4cfabd2-82b2-4e32-b20f-2b6fa1338c87 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:45.848241 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d4cfabd2-82b2-4e32-b20f-2b6fa1338c87 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:45.848996 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d4cfabd2-82b2-4e32-b20f-2b6fa1338c87 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:45.849419 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d4cfabd2-82b2-4e32-b20f-2b6fa1338c87 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:45.871600 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.objects.instance [None req-d4cfabd2-82b2-4e32-b20f-2b6fa1338c87 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lazy-loading 'flavor' on Instance uuid 5fb54ad3-a0af-43eb-b93a-9dff50509eea {{(pid=117142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 23:13:45.938735 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d4cfabd2-82b2-4e32-b20f-2b6fa1338c87 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "POST /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea/action" status: 202 len: 0 microversion: 2.1 time: 0.102205 May 09 23:13:45.939246 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 473/952] 10.222.0.23 () {60 vars in 1277 bytes} [Mon May 9 23:13:45 2022] POST /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:13:45.947973 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-4f49fad1-1ad2-4a10-b039-cfa7f32af8bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:13:45.948593 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-4f49fad1-1ad2-4a10-b039-cfa7f32af8bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:45.955718 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4f49fad1-1ad2-4a10-b039-cfa7f32af8bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:45.956314 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4f49fad1-1ad2-4a10-b039-cfa7f32af8bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:45.957740 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4f49fad1-1ad2-4a10-b039-cfa7f32af8bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:45.958292 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4f49fad1-1ad2-4a10-b039-cfa7f32af8bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:46.092429 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4f49fad1-1ad2-4a10-b039-cfa7f32af8bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:13:46.100374 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-4f49fad1-1ad2-4a10-b039-cfa7f32af8bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1567 microversion: 2.1 time: 0.156803 May 09 23:13:46.100975 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 480/953] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:13:45 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:13:47.119345 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-efe9bbb3-66ce-4fd7-bef5-3b359cf3c1bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:13:47.120045 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-efe9bbb3-66ce-4fd7-bef5-3b359cf3c1bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:47.126051 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-efe9bbb3-66ce-4fd7-bef5-3b359cf3c1bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:47.126527 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-efe9bbb3-66ce-4fd7-bef5-3b359cf3c1bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:47.127292 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-efe9bbb3-66ce-4fd7-bef5-3b359cf3c1bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:47.127723 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-efe9bbb3-66ce-4fd7-bef5-3b359cf3c1bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:47.258704 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-efe9bbb3-66ce-4fd7-bef5-3b359cf3c1bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:13:47.266012 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-efe9bbb3-66ce-4fd7-bef5-3b359cf3c1bb tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1567 microversion: 2.1 time: 0.151339 May 09 23:13:47.266615 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 474/954] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:13:47 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:13:48.283880 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-68a9d352-4fa7-4fa9-97d2-f54d19c69b3e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:13:48.284539 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-68a9d352-4fa7-4fa9-97d2-f54d19c69b3e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:48.291299 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-68a9d352-4fa7-4fa9-97d2-f54d19c69b3e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:48.291747 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-68a9d352-4fa7-4fa9-97d2-f54d19c69b3e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:48.292509 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-68a9d352-4fa7-4fa9-97d2-f54d19c69b3e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:48.292943 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-68a9d352-4fa7-4fa9-97d2-f54d19c69b3e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:48.419384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-68a9d352-4fa7-4fa9-97d2-f54d19c69b3e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:13:48.426643 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-68a9d352-4fa7-4fa9-97d2-f54d19c69b3e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1567 microversion: 2.1 time: 0.146778 May 09 23:13:48.427200 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 481/955] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:13:48 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:13:49.444244 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-80141c5a-456f-45d3-86c4-ed288ef930c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:13:49.444837 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-80141c5a-456f-45d3-86c4-ed288ef930c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:49.450679 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-80141c5a-456f-45d3-86c4-ed288ef930c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:49.451122 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-80141c5a-456f-45d3-86c4-ed288ef930c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:49.451873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-80141c5a-456f-45d3-86c4-ed288ef930c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:49.452299 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-80141c5a-456f-45d3-86c4-ed288ef930c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:49.577941 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-80141c5a-456f-45d3-86c4-ed288ef930c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:13:49.585127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-80141c5a-456f-45d3-86c4-ed288ef930c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1567 microversion: 2.1 time: 0.145432 May 09 23:13:49.585696 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 475/956] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:13:49 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:13:50.602003 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7479c59d-2175-4307-a3f3-97e74509c928 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:13:50.602651 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7479c59d-2175-4307-a3f3-97e74509c928 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:50.609735 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7479c59d-2175-4307-a3f3-97e74509c928 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:50.610216 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7479c59d-2175-4307-a3f3-97e74509c928 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:50.610987 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7479c59d-2175-4307-a3f3-97e74509c928 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:50.611425 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7479c59d-2175-4307-a3f3-97e74509c928 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:50.741032 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7479c59d-2175-4307-a3f3-97e74509c928 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:13:50.748317 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7479c59d-2175-4307-a3f3-97e74509c928 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1567 microversion: 2.1 time: 0.150191 May 09 23:13:50.748895 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 482/957] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:13:50 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:13:51.765345 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-854a32c8-5f75-4383-915e-609851839b44 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:13:51.765958 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-854a32c8-5f75-4383-915e-609851839b44 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:51.773171 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-854a32c8-5f75-4383-915e-609851839b44 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:51.773649 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-854a32c8-5f75-4383-915e-609851839b44 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:51.774438 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-854a32c8-5f75-4383-915e-609851839b44 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:51.774865 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-854a32c8-5f75-4383-915e-609851839b44 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:52.152192 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-854a32c8-5f75-4383-915e-609851839b44 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:13:52.159365 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-854a32c8-5f75-4383-915e-609851839b44 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1567 microversion: 2.1 time: 0.397905 May 09 23:13:52.160475 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 476/958] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:13:51 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1567 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:13:53.177312 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-90ea4b47-c314-4edb-9513-00705e07183e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:13:53.177914 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-90ea4b47-c314-4edb-9513-00705e07183e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:53.184357 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-90ea4b47-c314-4edb-9513-00705e07183e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:53.184810 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-90ea4b47-c314-4edb-9513-00705e07183e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:53.185581 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-90ea4b47-c314-4edb-9513-00705e07183e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:53.186019 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-90ea4b47-c314-4edb-9513-00705e07183e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:53.312458 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-90ea4b47-c314-4edb-9513-00705e07183e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:13:53.319733 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-90ea4b47-c314-4edb-9513-00705e07183e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1567 microversion: 2.1 time: 0.146907 May 09 23:13:53.320291 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 483/959] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:13:53 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:13:54.336456 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-7e8660d1-0b27-4752-93d8-23b0d98be96a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:13:54.337043 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-7e8660d1-0b27-4752-93d8-23b0d98be96a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:54.343575 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7e8660d1-0b27-4752-93d8-23b0d98be96a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:54.344031 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7e8660d1-0b27-4752-93d8-23b0d98be96a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:54.344812 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7e8660d1-0b27-4752-93d8-23b0d98be96a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:54.345539 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-7e8660d1-0b27-4752-93d8-23b0d98be96a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:54.473469 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-7e8660d1-0b27-4752-93d8-23b0d98be96a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:13:54.481091 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-7e8660d1-0b27-4752-93d8-23b0d98be96a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1567 microversion: 2.1 time: 0.148463 May 09 23:13:54.481654 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 477/960] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:13:54 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:13:55.497968 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-dcd8b467-bbfe-4e95-a0a8-7e4554f9f084 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:13:55.498609 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-dcd8b467-bbfe-4e95-a0a8-7e4554f9f084 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:55.505493 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dcd8b467-bbfe-4e95-a0a8-7e4554f9f084 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:55.505943 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dcd8b467-bbfe-4e95-a0a8-7e4554f9f084 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:55.506729 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dcd8b467-bbfe-4e95-a0a8-7e4554f9f084 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:55.507162 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dcd8b467-bbfe-4e95-a0a8-7e4554f9f084 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:55.637102 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-dcd8b467-bbfe-4e95-a0a8-7e4554f9f084 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:13:55.644634 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-dcd8b467-bbfe-4e95-a0a8-7e4554f9f084 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1567 microversion: 2.1 time: 0.150388 May 09 23:13:55.645211 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 484/961] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:13:55 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:13:56.661846 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-71312ec4-686b-4655-865f-2c3da234d4c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:13:56.662482 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-71312ec4-686b-4655-865f-2c3da234d4c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:56.668598 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-71312ec4-686b-4655-865f-2c3da234d4c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:56.669043 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-71312ec4-686b-4655-865f-2c3da234d4c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:56.669804 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-71312ec4-686b-4655-865f-2c3da234d4c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:56.670275 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-71312ec4-686b-4655-865f-2c3da234d4c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:56.798277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-71312ec4-686b-4655-865f-2c3da234d4c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:13:56.805459 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-71312ec4-686b-4655-865f-2c3da234d4c7 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1567 microversion: 2.1 time: 0.147453 May 09 23:13:56.806025 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 478/962] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:13:56 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:13:57.826632 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-72d5d363-18ac-4c41-8100-b54acd450589 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:13:57.827252 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-72d5d363-18ac-4c41-8100-b54acd450589 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:57.835462 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-72d5d363-18ac-4c41-8100-b54acd450589 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:57.835914 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-72d5d363-18ac-4c41-8100-b54acd450589 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:57.836682 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-72d5d363-18ac-4c41-8100-b54acd450589 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:57.837149 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-72d5d363-18ac-4c41-8100-b54acd450589 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:57.968215 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-72d5d363-18ac-4c41-8100-b54acd450589 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:13:57.975965 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-72d5d363-18ac-4c41-8100-b54acd450589 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1567 microversion: 2.1 time: 0.157545 May 09 23:13:57.976530 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 485/963] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:13:57 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:13:58.993128 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fa08e1f7-a7fd-4a3d-a57e-1d7c7c8fc719 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:13:58.993682 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-fa08e1f7-a7fd-4a3d-a57e-1d7c7c8fc719 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:59.000016 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fa08e1f7-a7fd-4a3d-a57e-1d7c7c8fc719 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:59.000466 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fa08e1f7-a7fd-4a3d-a57e-1d7c7c8fc719 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:59.001236 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fa08e1f7-a7fd-4a3d-a57e-1d7c7c8fc719 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:59.001670 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fa08e1f7-a7fd-4a3d-a57e-1d7c7c8fc719 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:59.132849 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-fa08e1f7-a7fd-4a3d-a57e-1d7c7c8fc719 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:13:59.140339 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-fa08e1f7-a7fd-4a3d-a57e-1d7c7c8fc719 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1568 microversion: 2.1 time: 0.151091 May 09 23:13:59.140927 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 479/964] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:13:58 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:13:59.157291 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-04f1d5b6-f0e1-4c88-ae45-87913d1768c8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:13:59.157863 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-04f1d5b6-f0e1-4c88-ae45-87913d1768c8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:59.164521 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-04f1d5b6-f0e1-4c88-ae45-87913d1768c8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:59.164967 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-04f1d5b6-f0e1-4c88-ae45-87913d1768c8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:59.165733 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-04f1d5b6-f0e1-4c88-ae45-87913d1768c8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:59.166183 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-04f1d5b6-f0e1-4c88-ae45-87913d1768c8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:59.247411 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-04f1d5b6-f0e1-4c88-ae45-87913d1768c8 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "POST /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea/action" status: 202 len: 0 microversion: 2.1 time: 0.093893 May 09 23:13:59.247941 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 486/965] 10.222.0.23 () {60 vars in 1277 bytes} [Mon May 9 23:13:59 2022] POST /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:13:59.256379 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-8605d0d1-7c58-40bc-8c2f-b1278dc8e40e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:13:59.257008 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-8605d0d1-7c58-40bc-8c2f-b1278dc8e40e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:13:59.262924 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8605d0d1-7c58-40bc-8c2f-b1278dc8e40e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:59.263379 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8605d0d1-7c58-40bc-8c2f-b1278dc8e40e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:59.264154 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8605d0d1-7c58-40bc-8c2f-b1278dc8e40e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:13:59.264592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8605d0d1-7c58-40bc-8c2f-b1278dc8e40e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:13:59.409510 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-8605d0d1-7c58-40bc-8c2f-b1278dc8e40e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:13:59.417659 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-8605d0d1-7c58-40bc-8c2f-b1278dc8e40e tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1516 microversion: 2.1 time: 0.165599 May 09 23:13:59.418263 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 480/966] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:13:59 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:00.436118 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-7a847c2f-39a0-453d-82da-17701aac64f9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:00.436739 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-7a847c2f-39a0-453d-82da-17701aac64f9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:00.443082 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7a847c2f-39a0-453d-82da-17701aac64f9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:00.443521 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7a847c2f-39a0-453d-82da-17701aac64f9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:00.444273 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7a847c2f-39a0-453d-82da-17701aac64f9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:00.444700 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-7a847c2f-39a0-453d-82da-17701aac64f9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:00.572395 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-7a847c2f-39a0-453d-82da-17701aac64f9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:00.579601 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-7a847c2f-39a0-453d-82da-17701aac64f9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1516 microversion: 2.1 time: 0.147855 May 09 23:14:00.580170 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 487/967] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:00 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:01.596528 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d294bcf9-f8aa-4038-994c-065aeec19821 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:01.597144 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-d294bcf9-f8aa-4038-994c-065aeec19821 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:01.603538 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d294bcf9-f8aa-4038-994c-065aeec19821 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:01.603988 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d294bcf9-f8aa-4038-994c-065aeec19821 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:01.605017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d294bcf9-f8aa-4038-994c-065aeec19821 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:01.605453 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d294bcf9-f8aa-4038-994c-065aeec19821 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:01.732059 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-d294bcf9-f8aa-4038-994c-065aeec19821 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:01.740990 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d294bcf9-f8aa-4038-994c-065aeec19821 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1516 microversion: 2.1 time: 0.148297 May 09 23:14:01.741567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 481/968] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:01 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:02.757859 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-31b1822e-069a-4c0d-88cd-dcca68caaef5 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:02.758518 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-31b1822e-069a-4c0d-88cd-dcca68caaef5 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:02.764749 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31b1822e-069a-4c0d-88cd-dcca68caaef5 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:02.765194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31b1822e-069a-4c0d-88cd-dcca68caaef5 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:02.765953 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31b1822e-069a-4c0d-88cd-dcca68caaef5 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:02.766474 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31b1822e-069a-4c0d-88cd-dcca68caaef5 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:02.893520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-31b1822e-069a-4c0d-88cd-dcca68caaef5 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:02.901380 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-31b1822e-069a-4c0d-88cd-dcca68caaef5 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1516 microversion: 2.1 time: 0.147340 May 09 23:14:02.902033 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 488/969] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:02 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:03.253350 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-0a76b442-487f-434c-9b88-e659fc4321a3 req-47538b58-9faa-4941-bd93-a5ae23511034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb54ad3-a0af-43eb-b93a-9dff50509eea", "name": "network-vif-unplugged", "status": "completed", "tag": "b358901e-4e0b-4ec4-b3a8-96987f94191c"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:14:03.261421 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-0a76b442-487f-434c-9b88-e659fc4321a3 req-47538b58-9faa-4941-bd93-a5ae23511034 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:03.261924 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-0a76b442-487f-434c-9b88-e659fc4321a3 req-47538b58-9faa-4941-bd93-a5ae23511034 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:03.274083 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.compute.server_external_events [req-0a76b442-487f-434c-9b88-e659fc4321a3 req-47538b58-9faa-4941-bd93-a5ae23511034 service nova] Unable to find a host for instance 5fb54ad3-a0af-43eb-b93a-9dff50509eea. Dropping event network-vif-unplugged {{(pid=117142) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 09 23:14:03.274998 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-0a76b442-487f-434c-9b88-e659fc4321a3 req-47538b58-9faa-4941-bd93-a5ae23511034 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.084508 May 09 23:14:03.275580 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 482/970] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 86 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 09 23:14:03.919100 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ae0c7be8-e7c2-4326-9be7-f5831917128d tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:03.919645 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ae0c7be8-e7c2-4326-9be7-f5831917128d tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:03.925886 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae0c7be8-e7c2-4326-9be7-f5831917128d tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:03.926372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae0c7be8-e7c2-4326-9be7-f5831917128d tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:03.927135 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae0c7be8-e7c2-4326-9be7-f5831917128d tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:03.927565 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ae0c7be8-e7c2-4326-9be7-f5831917128d tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:04.054618 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ae0c7be8-e7c2-4326-9be7-f5831917128d tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:04.061828 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ae0c7be8-e7c2-4326-9be7-f5831917128d tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1516 microversion: 2.1 time: 0.146722 May 09 23:14:04.062432 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 489/971] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:03 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1516 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:05.079815 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-efc16207-ef1e-4ff1-96c7-12b77a4009b0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:05.080440 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-efc16207-ef1e-4ff1-96c7-12b77a4009b0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:05.086925 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-efc16207-ef1e-4ff1-96c7-12b77a4009b0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:05.087393 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-efc16207-ef1e-4ff1-96c7-12b77a4009b0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:05.088211 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-efc16207-ef1e-4ff1-96c7-12b77a4009b0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:05.088688 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-efc16207-ef1e-4ff1-96c7-12b77a4009b0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:05.225208 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-efc16207-ef1e-4ff1-96c7-12b77a4009b0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:05.232886 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-efc16207-ef1e-4ff1-96c7-12b77a4009b0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1574 microversion: 2.1 time: 0.157626 May 09 23:14:05.233461 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 483/972] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:05 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:06.250776 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-bf031d59-75e6-4361-9864-9b18040db2cf tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:06.251395 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-bf031d59-75e6-4361-9864-9b18040db2cf tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:06.257835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bf031d59-75e6-4361-9864-9b18040db2cf tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:06.258316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bf031d59-75e6-4361-9864-9b18040db2cf tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:06.259094 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bf031d59-75e6-4361-9864-9b18040db2cf tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:06.259531 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bf031d59-75e6-4361-9864-9b18040db2cf tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:06.387472 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-bf031d59-75e6-4361-9864-9b18040db2cf tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:06.395294 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-bf031d59-75e6-4361-9864-9b18040db2cf tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1574 microversion: 2.1 time: 0.148343 May 09 23:14:06.395867 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 490/973] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:06 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:07.412487 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-6144605c-76ba-4613-84dd-5dedbc88b37a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:07.413007 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-6144605c-76ba-4613-84dd-5dedbc88b37a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:07.419330 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6144605c-76ba-4613-84dd-5dedbc88b37a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:07.419788 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6144605c-76ba-4613-84dd-5dedbc88b37a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:07.420559 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6144605c-76ba-4613-84dd-5dedbc88b37a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:07.420998 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-6144605c-76ba-4613-84dd-5dedbc88b37a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:07.712127 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-6144605c-76ba-4613-84dd-5dedbc88b37a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:07.719407 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-6144605c-76ba-4613-84dd-5dedbc88b37a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1574 microversion: 2.1 time: 0.310948 May 09 23:14:07.719974 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 484/974] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:07 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1574 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:08.736678 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2b89ae47-ff63-4c4b-a3a4-24b4008cbfa9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:08.737281 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2b89ae47-ff63-4c4b-a3a4-24b4008cbfa9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:08.744180 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2b89ae47-ff63-4c4b-a3a4-24b4008cbfa9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:08.744619 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2b89ae47-ff63-4c4b-a3a4-24b4008cbfa9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:08.745374 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2b89ae47-ff63-4c4b-a3a4-24b4008cbfa9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:08.745801 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2b89ae47-ff63-4c4b-a3a4-24b4008cbfa9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:08.873184 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2b89ae47-ff63-4c4b-a3a4-24b4008cbfa9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:08.880382 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2b89ae47-ff63-4c4b-a3a4-24b4008cbfa9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1574 microversion: 2.1 time: 0.147534 May 09 23:14:08.880882 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 491/975] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:08 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:09.896251 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1b7b33f2-5efb-49fe-a23c-38f95f08b43a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:09.896781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1b7b33f2-5efb-49fe-a23c-38f95f08b43a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:09.903087 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b7b33f2-5efb-49fe-a23c-38f95f08b43a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:09.903544 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b7b33f2-5efb-49fe-a23c-38f95f08b43a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:09.904317 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b7b33f2-5efb-49fe-a23c-38f95f08b43a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:09.904749 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b7b33f2-5efb-49fe-a23c-38f95f08b43a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:10.029980 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1b7b33f2-5efb-49fe-a23c-38f95f08b43a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:10.037239 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1b7b33f2-5efb-49fe-a23c-38f95f08b43a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1574 microversion: 2.1 time: 0.144886 May 09 23:14:10.037797 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 485/976] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:09 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:11.054512 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-2a727571-d392-47b9-9bee-ff131dc14aa2 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:11.055114 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-2a727571-d392-47b9-9bee-ff131dc14aa2 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:11.061273 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2a727571-d392-47b9-9bee-ff131dc14aa2 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:11.061715 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2a727571-d392-47b9-9bee-ff131dc14aa2 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:11.062498 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2a727571-d392-47b9-9bee-ff131dc14aa2 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:11.062924 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-2a727571-d392-47b9-9bee-ff131dc14aa2 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:11.193341 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-2a727571-d392-47b9-9bee-ff131dc14aa2 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:11.200552 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-2a727571-d392-47b9-9bee-ff131dc14aa2 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1574 microversion: 2.1 time: 0.149880 May 09 23:14:11.201107 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 492/977] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:11 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:12.217376 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-15e6980b-0c3f-41b3-9e70-adfeae809529 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:12.218015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-15e6980b-0c3f-41b3-9e70-adfeae809529 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:12.224261 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-15e6980b-0c3f-41b3-9e70-adfeae809529 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:12.224707 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-15e6980b-0c3f-41b3-9e70-adfeae809529 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:12.225470 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-15e6980b-0c3f-41b3-9e70-adfeae809529 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:12.225903 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-15e6980b-0c3f-41b3-9e70-adfeae809529 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:12.357587 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-15e6980b-0c3f-41b3-9e70-adfeae809529 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:12.365617 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-15e6980b-0c3f-41b3-9e70-adfeae809529 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1574 microversion: 2.1 time: 0.152051 May 09 23:14:12.366195 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 486/978] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:12 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:13.383349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-69040a6a-51b5-42ac-9851-7515cf698188 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:13.383895 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-69040a6a-51b5-42ac-9851-7515cf698188 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:13.390229 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-69040a6a-51b5-42ac-9851-7515cf698188 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:13.390684 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-69040a6a-51b5-42ac-9851-7515cf698188 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:13.391451 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-69040a6a-51b5-42ac-9851-7515cf698188 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:13.391883 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-69040a6a-51b5-42ac-9851-7515cf698188 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:13.522683 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-69040a6a-51b5-42ac-9851-7515cf698188 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:13.529962 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-69040a6a-51b5-42ac-9851-7515cf698188 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1574 microversion: 2.1 time: 0.150592 May 09 23:14:13.530559 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 493/979] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:13 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:14.546329 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1b3cc6e2-36ac-4bd5-9959-2751ff3ffd5f tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:14.546940 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1b3cc6e2-36ac-4bd5-9959-2751ff3ffd5f tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:14.553702 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b3cc6e2-36ac-4bd5-9959-2751ff3ffd5f tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:14.554181 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b3cc6e2-36ac-4bd5-9959-2751ff3ffd5f tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:14.554955 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b3cc6e2-36ac-4bd5-9959-2751ff3ffd5f tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:14.555390 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1b3cc6e2-36ac-4bd5-9959-2751ff3ffd5f tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:14.682699 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-1b3cc6e2-36ac-4bd5-9959-2751ff3ffd5f tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:14.690055 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1b3cc6e2-36ac-4bd5-9959-2751ff3ffd5f tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1574 microversion: 2.1 time: 0.147704 May 09 23:14:14.690641 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 487/980] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:14 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:15.269008 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-4b17a980-7f4f-4c39-b205-66028e900694 req-5b345d31-9975-4dc4-9de4-f29e20b96cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb54ad3-a0af-43eb-b93a-9dff50509eea", "name": "network-vif-plugged", "status": "completed", "tag": "b358901e-4e0b-4ec4-b3a8-96987f94191c"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:14:15.278050 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-4b17a980-7f4f-4c39-b205-66028e900694 req-5b345d31-9975-4dc4-9de4-f29e20b96cfd service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:15.278522 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-4b17a980-7f4f-4c39-b205-66028e900694 req-5b345d31-9975-4dc4-9de4-f29e20b96cfd service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:15.289372 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-4b17a980-7f4f-4c39-b205-66028e900694 req-5b345d31-9975-4dc4-9de4-f29e20b96cfd service nova] Creating event network-vif-plugged:b358901e-4e0b-4ec4-b3a8-96987f94191c for instance 5fb54ad3-a0af-43eb-b93a-9dff50509eea on hv-cinder-84067 May 09 23:14:15.294529 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-4b17a980-7f4f-4c39-b205-66028e900694 req-5b345d31-9975-4dc4-9de4-f29e20b96cfd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029157 May 09 23:14:15.295122 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 494/981] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:14:15.707619 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-08615dec-607d-43fc-8167-47a1dd4a21d0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:15.708237 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-08615dec-607d-43fc-8167-47a1dd4a21d0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:15.714548 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-08615dec-607d-43fc-8167-47a1dd4a21d0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:15.715003 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-08615dec-607d-43fc-8167-47a1dd4a21d0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:15.715779 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-08615dec-607d-43fc-8167-47a1dd4a21d0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:15.716215 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-08615dec-607d-43fc-8167-47a1dd4a21d0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:15.849605 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-08615dec-607d-43fc-8167-47a1dd4a21d0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:15.857192 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-08615dec-607d-43fc-8167-47a1dd4a21d0 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1574 microversion: 2.1 time: 0.153434 May 09 23:14:15.857756 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 488/982] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:15 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:16.875426 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-dd054dad-0001-4339-9f1d-d7c1eddfb349 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:14:16.876150 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-dd054dad-0001-4339-9f1d-d7c1eddfb349 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:14:16.882308 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dd054dad-0001-4339-9f1d-d7c1eddfb349 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:16.882707 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dd054dad-0001-4339-9f1d-d7c1eddfb349 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:16.883474 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dd054dad-0001-4339-9f1d-d7c1eddfb349 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:14:16.883944 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dd054dad-0001-4339-9f1d-d7c1eddfb349 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:14:17.014378 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-dd054dad-0001-4339-9f1d-d7c1eddfb349 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:14:17.022316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-dd054dad-0001-4339-9f1d-d7c1eddfb349 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1561 microversion: 2.1 time: 0.151540 May 09 23:14:17.022881 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 495/983] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:14:16 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:14:29.952922 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:14:29.953576 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Mon May 9 23:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 23:15:36.509919 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c54f189d-675c-41e9-be51-1486ad8b1c03 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:15:36.510489 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c54f189d-675c-41e9-be51-1486ad8b1c03 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:15:36.517299 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c54f189d-675c-41e9-be51-1486ad8b1c03 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:15:36.517828 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c54f189d-675c-41e9-be51-1486ad8b1c03 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:15:36.518717 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c54f189d-675c-41e9-be51-1486ad8b1c03 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:15:36.519232 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c54f189d-675c-41e9-be51-1486ad8b1c03 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:15:36.549000 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c54f189d-675c-41e9-be51-1486ad8b1c03 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Going to try to terminate instance {{(pid=117142) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:15:36.632517 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c54f189d-675c-41e9-be51-1486ad8b1c03 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 204 len: 0 microversion: 2.1 time: 0.127488 May 09 23:15:36.634919 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 489/984] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:15:36 2022] DELETE /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:15:36.644207 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-636bd0b8-3843-40dc-821d-cd88c61ad78c tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:15:36.645056 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-636bd0b8-3843-40dc-821d-cd88c61ad78c tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:15:36.652310 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-636bd0b8-3843-40dc-821d-cd88c61ad78c tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:15:36.653043 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-636bd0b8-3843-40dc-821d-cd88c61ad78c tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:15:36.653826 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-636bd0b8-3843-40dc-821d-cd88c61ad78c tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:15:36.655320 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-636bd0b8-3843-40dc-821d-cd88c61ad78c tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:15:36.672365 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-5ec89c50-9e9e-4719-a0a7-4337a5cdcf39 req-3b1bea3d-8f61-4f88-8852-3fe9686103eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb54ad3-a0af-43eb-b93a-9dff50509eea", "tag": "b358901e-4e0b-4ec4-b3a8-96987f94191c"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:15:36.680962 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-5ec89c50-9e9e-4719-a0a7-4337a5cdcf39 req-3b1bea3d-8f61-4f88-8852-3fe9686103eb service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:15:36.681400 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-5ec89c50-9e9e-4719-a0a7-4337a5cdcf39 req-3b1bea3d-8f61-4f88-8852-3fe9686103eb service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:15:36.692811 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-5ec89c50-9e9e-4719-a0a7-4337a5cdcf39 req-3b1bea3d-8f61-4f88-8852-3fe9686103eb service nova] Creating event network-changed:b358901e-4e0b-4ec4-b3a8-96987f94191c for instance 5fb54ad3-a0af-43eb-b93a-9dff50509eea on hv-cinder-84067 May 09 23:15:36.698394 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-5ec89c50-9e9e-4719-a0a7-4337a5cdcf39 req-3b1bea3d-8f61-4f88-8852-3fe9686103eb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190406 May 09 23:15:36.699562 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 496/985] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:15:36.793050 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-636bd0b8-3843-40dc-821d-cd88c61ad78c tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:15:36.800639 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-636bd0b8-3843-40dc-821d-cd88c61ad78c tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1567 microversion: 2.1 time: 0.160818 May 09 23:15:36.801299 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 490/986] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:15:36 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:15:37.819731 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a6fb0876-a14f-43ed-aeaa-b4808e1653ec tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:15:37.820357 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a6fb0876-a14f-43ed-aeaa-b4808e1653ec tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:15:37.826448 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a6fb0876-a14f-43ed-aeaa-b4808e1653ec tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:15:37.826894 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a6fb0876-a14f-43ed-aeaa-b4808e1653ec tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:15:37.827650 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a6fb0876-a14f-43ed-aeaa-b4808e1653ec tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:15:37.828074 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a6fb0876-a14f-43ed-aeaa-b4808e1653ec tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:15:37.969192 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a6fb0876-a14f-43ed-aeaa-b4808e1653ec tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:15:37.977279 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a6fb0876-a14f-43ed-aeaa-b4808e1653ec tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1567 microversion: 2.1 time: 0.163074 May 09 23:15:37.977845 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 497/987] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:15:37 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:15:39.000847 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-d64343f8-555f-4718-817c-af28853e43d9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:15:39.008901 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-d64343f8-555f-4718-817c-af28853e43d9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:15:39.019306 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d64343f8-555f-4718-817c-af28853e43d9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:15:39.019790 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d64343f8-555f-4718-817c-af28853e43d9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:15:39.020587 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d64343f8-555f-4718-817c-af28853e43d9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:15:39.021027 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-d64343f8-555f-4718-817c-af28853e43d9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:15:39.021782 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-65ec5b47-fecc-4690-ab57-9b07d5b78fe3 req-813740d2-5f9d-4609-8f45-978301562194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb54ad3-a0af-43eb-b93a-9dff50509eea", "name": "network-vif-deleted", "tag": "b358901e-4e0b-4ec4-b3a8-96987f94191c"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:15:39.031062 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-65ec5b47-fecc-4690-ab57-9b07d5b78fe3 req-813740d2-5f9d-4609-8f45-978301562194 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:15:39.031596 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-65ec5b47-fecc-4690-ab57-9b07d5b78fe3 req-813740d2-5f9d-4609-8f45-978301562194 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:15:39.042563 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-65ec5b47-fecc-4690-ab57-9b07d5b78fe3 req-813740d2-5f9d-4609-8f45-978301562194 service nova] Creating event network-vif-deleted:b358901e-4e0b-4ec4-b3a8-96987f94191c for instance 5fb54ad3-a0af-43eb-b93a-9dff50509eea on hv-cinder-84067 May 09 23:15:39.047342 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-65ec5b47-fecc-4690-ab57-9b07d5b78fe3 req-813740d2-5f9d-4609-8f45-978301562194 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089556 May 09 23:15:39.047931 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 491/988] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:15:39.082746 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-d64343f8-555f-4718-817c-af28853e43d9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2656d339a74bd882c2226251ac3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130ce8965a764f6d8910c2bba4561534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:15:39.089999 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-d64343f8-555f-4718-817c-af28853e43d9 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 200 len: 1218 microversion: 2.1 time: 0.099517 May 09 23:15:39.090591 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 498/989] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:15:38 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:15:40.108078 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-83022409-0548-496d-94cc-ab9150df533a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:15:40.108837 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-83022409-0548-496d-94cc-ab9150df533a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] [instance: 5fb54ad3-a0af-43eb-b93a-9dff50509eea] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:15:40.115537 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-83022409-0548-496d-94cc-ab9150df533a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:15:40.115983 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-83022409-0548-496d-94cc-ab9150df533a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:15:40.116746 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-83022409-0548-496d-94cc-ab9150df533a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:15:40.117177 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-83022409-0548-496d-94cc-ab9150df533a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:15:40.130935 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-83022409-0548-496d-94cc-ab9150df533a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] HTTP exception thrown: Instance 5fb54ad3-a0af-43eb-b93a-9dff50509eea could not be found. May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-83022409-0548-496d-94cc-ab9150df533a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Request method failure captured: May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea HTTP/1.1 May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieZ-MAKLgHFAWuHOg6H--ANjL4GDXT0vIC1bxHtO6EmOQ2T2C4Mpb8QDWzZD0SbnnEqN9-nzjCQJJ0WB4rDE0XyLYW_v1fSD-A0RnVwkcFS1pG8JfjWhQGsJMErIbp-uX2txfOEYEOeKsFmw-8_rNaoSAH79MpqfBW_tUBoxP-_r7qo8 May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: 130ce8965a764f6d8910c2bba4561534 May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-TestShelveInstance-445535987 May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:15:40.132534 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:15:40.134242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/130ce8965a764f6d8910c2bba4561534"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_130ce8965a764f6d8910c2bba4561534"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/130ce8965a764f6d8910c2bba4561534"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/130ce8965a764f6d8910c2bba4561534"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:15:40.134242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-TestShelveInstance-445535987 May 09 23:15:40.134242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: 130ce8965a764f6d8910c2bba4561534 May 09 23:15:40.134242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-TestShelveInstance-445535987 May 09 23:15:40.134242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-TestShelveInstance-445535987-project May 09 23:15:40.134242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:15:40.134242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:15:40.134242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 4e2656d339a74bd882c2226251ac3d36 May 09 23:15:40.134242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-TestShelveInstance-445535987-project May 09 23:15:40.134242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:15:40.134242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 5fb54ad3-a0af-43eb-b93a-9dff50509eea could not be found. May 09 23:15:40.134242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '5fb54ad3-a0af-43eb-b93a-9dff50509eea'} May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb54ad3-a0af-43eb-b93a-9dff50509eea could not be found. May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:15:40.135300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb54ad3-a0af-43eb-b93a-9dff50509eea could not be found. May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb54ad3-a0af-43eb-b93a-9dff50509eea could not be found. May 09 23:15:40.136870 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:15:40.138266 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-83022409-0548-496d-94cc-ab9150df533a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Returning 404 to user: Instance 5fb54ad3-a0af-43eb-b93a-9dff50509eea could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:15:40.138266 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-83022409-0548-496d-94cc-ab9150df533a tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea" status: 404 len: 111 microversion: 2.1 time: 0.030716 May 09 23:15:40.138266 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 492/990] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:15:40 2022] GET /compute/v2.1/servers/5fb54ad3-a0af-43eb-b93a-9dff50509eea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:15:40.293398 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-1c28efbf-706a-4eae-84ca-51e3a9f7c979 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] Calling method '.version_select at 0x7fc29829c5e0>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:15:40.314791 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-1c28efbf-706a-4eae-84ca-51e3a9f7c979 tempest-TestShelveInstance-445535987 tempest-TestShelveInstance-445535987-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-707952866" status: 202 len: 0 microversion: 2.1 time: 0.025714 May 09 23:15:40.316422 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 499/991] 10.222.0.23 () {58 vars in 1250 bytes} [Mon May 9 23:15:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-707952866 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:15:45.433079 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:15:45.433612 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Mon May 9 23:15:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 23:15:57.119648 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-3d96542a-707e-49de-aa03-c92ad7e31d4d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Action: 'create', calling method: .version_select at 0x7fc29ccee430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-354173559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/NfKCKONUbAeXc0zjaVNy94aaGAaUxByVodm0Bn9cltSgI4TbyOXyIU5N5N6ZnXutyD/yhujQ3/peqTb73Zlv9d7OOp4b8Nas4gYHjgkqVgjsNRDZtukY9QnXhq+eQJw=="}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:15:57.133661 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-3d96542a-707e-49de-aa03-c92ad7e31d4d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Getting quotas for project d557435c4af9467999e66a94c6929e11. Resources: {'key_pairs'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:15:57.137805 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-3d96542a-707e-49de-aa03-c92ad7e31d4d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Getting quotas for user 069d3a8dd790459db3bcfea55f8e19f4 and project d557435c4af9467999e66a94c6929e11. Resources: {'key_pairs'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:15:57.164132 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-3d96542a-707e-49de-aa03-c92ad7e31d4d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.203317 May 09 23:15:57.164728 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 493/992] 10.222.0.23 () {60 vars in 1158 bytes} [Mon May 9 23:15:56 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:16:14.459191 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-594642582", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-354173559", "security_groups": [{"name": "tempest-secgroup-smoke-40112821"}], "block_device_mapping_v2": [{"uuid": "f4f4354c-7eeb-44cf-b1c7-17d63285a2da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6ac40a30-c19e-4dfc-b8a0-754027b1e1e5"}]}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:16:14.568486 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.network.neutron [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] validate_networks() for [('6ac40a30-c19e-4dfc-b8a0-754027b1e1e5', None, None, None, None, None)] {{(pid=117143) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:16:15.017349 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Flavor limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:16:15.017877 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Image limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:16:15.018514 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Flavor pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:16:15.019526 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Image pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:16:15.020048 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:16:15.028793 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:15.029238 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:15.030047 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:15.030520 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:15.047582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Getting quotas for project d557435c4af9467999e66a94c6929e11. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:16:15.051411 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Getting quotas for user 069d3a8dd790459db3bcfea55f8e19f4 and project d557435c4af9467999e66a94c6929e11. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:16:15.106709 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Going to run 1 instances... {{(pid=117143) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:16:15.108821 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f4f4354c-7eeb-44cf-b1c7-17d63285a2da',volume_size=None,volume_type=None)] {{(pid=117143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:16:15.229262 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6e77f29a-654c-46e7-8c79-013098953e9e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.774194 May 09 23:16:15.229939 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 500/993] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:16:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:16:15.239943 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c26cbe04-8f13-403e-98b4-09727f1de0e9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:15.240565 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c26cbe04-8f13-403e-98b4-09727f1de0e9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:15.295751 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c26cbe04-8f13-403e-98b4-09727f1de0e9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:15.302300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c26cbe04-8f13-403e-98b4-09727f1de0e9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1093 microversion: 2.1 time: 0.066342 May 09 23:16:15.302861 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 494/994] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:15 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:16:16.319453 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e11843f2-421a-4ce6-b684-efc21944e153 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:16.320152 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e11843f2-421a-4ce6-b684-efc21944e153 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:16.327637 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e11843f2-421a-4ce6-b684-efc21944e153 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:16.328194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e11843f2-421a-4ce6-b684-efc21944e153 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:16.329087 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e11843f2-421a-4ce6-b684-efc21944e153 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:16.329594 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e11843f2-421a-4ce6-b684-efc21944e153 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:16.404086 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e11843f2-421a-4ce6-b684-efc21944e153 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:16.411454 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e11843f2-421a-4ce6-b684-efc21944e153 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1209 microversion: 2.1 time: 0.096495 May 09 23:16:16.412022 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 501/995] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:16 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:16:17.429677 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a1c4cd17-f636-4bc2-9b79-4720ae4c3990 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:17.430492 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a1c4cd17-f636-4bc2-9b79-4720ae4c3990 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:17.437348 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a1c4cd17-f636-4bc2-9b79-4720ae4c3990 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:17.437973 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a1c4cd17-f636-4bc2-9b79-4720ae4c3990 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:17.439435 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a1c4cd17-f636-4bc2-9b79-4720ae4c3990 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:17.439990 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a1c4cd17-f636-4bc2-9b79-4720ae4c3990 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:17.531054 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-1ad0bdb0-5e2c-4adb-a0d0-d563e0c5648b req-8208aa6a-af66-45ee-963b-4dca98ffb141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b8028e-96dc-484d-926f-782a423ff712", "tag": "02457c86-3b08-41a7-b0ab-fc08377221ab"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:16:17.541189 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-1ad0bdb0-5e2c-4adb-a0d0-d563e0c5648b req-8208aa6a-af66-45ee-963b-4dca98ffb141 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:17.541677 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-1ad0bdb0-5e2c-4adb-a0d0-d563e0c5648b req-8208aa6a-af66-45ee-963b-4dca98ffb141 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:17.559109 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-1ad0bdb0-5e2c-4adb-a0d0-d563e0c5648b req-8208aa6a-af66-45ee-963b-4dca98ffb141 service nova] Creating event network-changed:02457c86-3b08-41a7-b0ab-fc08377221ab for instance 91b8028e-96dc-484d-926f-782a423ff712 on hv-cinder-84067 May 09 23:16:17.564527 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-1ad0bdb0-5e2c-4adb-a0d0-d563e0c5648b req-8208aa6a-af66-45ee-963b-4dca98ffb141 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037013 May 09 23:16:17.565872 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 502/996] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:16:17.663629 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a1c4cd17-f636-4bc2-9b79-4720ae4c3990 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:17.672565 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a1c4cd17-f636-4bc2-9b79-4720ae4c3990 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1263 microversion: 2.1 time: 0.247845 May 09 23:16:17.673342 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 495/997] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:17 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1263 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:16:18.690383 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-09541573-165d-45fc-888e-da32247f6d24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:18.691078 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-09541573-165d-45fc-888e-da32247f6d24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:18.697553 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-09541573-165d-45fc-888e-da32247f6d24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:18.697998 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-09541573-165d-45fc-888e-da32247f6d24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:18.698785 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-09541573-165d-45fc-888e-da32247f6d24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:18.699216 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-09541573-165d-45fc-888e-da32247f6d24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:18.825559 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-09541573-165d-45fc-888e-da32247f6d24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:18.833283 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-09541573-165d-45fc-888e-da32247f6d24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1263 microversion: 2.1 time: 0.147011 May 09 23:16:18.833843 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 503/998] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:18 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:16:19.850086 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-2adc267b-85ab-410d-8c08-cf58155b8793 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:19.850726 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-2adc267b-85ab-410d-8c08-cf58155b8793 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:19.857128 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2adc267b-85ab-410d-8c08-cf58155b8793 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:19.857569 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2adc267b-85ab-410d-8c08-cf58155b8793 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:19.858375 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2adc267b-85ab-410d-8c08-cf58155b8793 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:19.858820 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2adc267b-85ab-410d-8c08-cf58155b8793 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:20.004885 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-2adc267b-85ab-410d-8c08-cf58155b8793 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:20.012123 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-2adc267b-85ab-410d-8c08-cf58155b8793 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1263 microversion: 2.1 time: 0.165946 May 09 23:16:20.012691 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 496/999] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:19 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:16:21.029489 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5c197a3a-34c8-40d5-86a2-355b9160c86d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:21.030101 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-5c197a3a-34c8-40d5-86a2-355b9160c86d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:21.036614 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5c197a3a-34c8-40d5-86a2-355b9160c86d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:21.037065 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5c197a3a-34c8-40d5-86a2-355b9160c86d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:21.037865 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5c197a3a-34c8-40d5-86a2-355b9160c86d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:21.038354 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5c197a3a-34c8-40d5-86a2-355b9160c86d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:21.170334 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-5c197a3a-34c8-40d5-86a2-355b9160c86d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:21.178095 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-5c197a3a-34c8-40d5-86a2-355b9160c86d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1263 microversion: 2.1 time: 0.152456 May 09 23:16:21.178697 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 504/1000] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:21 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:16:22.194789 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-8779712d-2f8e-4d1e-b496-04c316d1cc03 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:22.195401 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-8779712d-2f8e-4d1e-b496-04c316d1cc03 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:22.201713 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8779712d-2f8e-4d1e-b496-04c316d1cc03 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:22.202195 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8779712d-2f8e-4d1e-b496-04c316d1cc03 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:22.202962 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8779712d-2f8e-4d1e-b496-04c316d1cc03 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:22.203394 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8779712d-2f8e-4d1e-b496-04c316d1cc03 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:22.335409 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-8779712d-2f8e-4d1e-b496-04c316d1cc03 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:22.342615 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-8779712d-2f8e-4d1e-b496-04c316d1cc03 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1263 microversion: 2.1 time: 0.151684 May 09 23:16:22.343243 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 497/1001] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:22 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:16:23.360187 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a7357e8c-29ed-410c-af56-edebdb1dbed2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:23.360811 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a7357e8c-29ed-410c-af56-edebdb1dbed2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:23.367948 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a7357e8c-29ed-410c-af56-edebdb1dbed2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:23.368408 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a7357e8c-29ed-410c-af56-edebdb1dbed2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:23.369178 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a7357e8c-29ed-410c-af56-edebdb1dbed2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:23.369615 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a7357e8c-29ed-410c-af56-edebdb1dbed2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:23.494843 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a7357e8c-29ed-410c-af56-edebdb1dbed2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:23.501942 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a7357e8c-29ed-410c-af56-edebdb1dbed2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1263 microversion: 2.1 time: 0.145631 May 09 23:16:23.502535 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 505/1002] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:23 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:16:24.519886 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-2c545d5c-6678-43c0-aeed-285ca4096a74 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:24.520518 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-2c545d5c-6678-43c0-aeed-285ca4096a74 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:24.526873 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2c545d5c-6678-43c0-aeed-285ca4096a74 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:24.527327 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2c545d5c-6678-43c0-aeed-285ca4096a74 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:24.528098 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2c545d5c-6678-43c0-aeed-285ca4096a74 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:24.528533 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-2c545d5c-6678-43c0-aeed-285ca4096a74 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:24.908374 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-2c545d5c-6678-43c0-aeed-285ca4096a74 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:24.917390 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-2c545d5c-6678-43c0-aeed-285ca4096a74 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1263 microversion: 2.1 time: 0.402018 May 09 23:16:24.917955 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 498/1003] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:24 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1263 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:16:25.934038 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-dacc2209-813b-4ecc-9e83-bd199c0c7870 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:25.934708 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-dacc2209-813b-4ecc-9e83-bd199c0c7870 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:25.941936 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dacc2209-813b-4ecc-9e83-bd199c0c7870 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:25.942416 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dacc2209-813b-4ecc-9e83-bd199c0c7870 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:25.943190 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dacc2209-813b-4ecc-9e83-bd199c0c7870 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:25.943625 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-dacc2209-813b-4ecc-9e83-bd199c0c7870 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:26.080504 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-dacc2209-813b-4ecc-9e83-bd199c0c7870 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:26.088385 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-dacc2209-813b-4ecc-9e83-bd199c0c7870 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1263 microversion: 2.1 time: 0.158263 May 09 23:16:26.088953 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 506/1004] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:25 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:16:27.105474 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-00b2e864-c5fc-4e88-a4ca-4495e4505c04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:27.106078 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-00b2e864-c5fc-4e88-a4ca-4495e4505c04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:27.112533 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-00b2e864-c5fc-4e88-a4ca-4495e4505c04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:27.113242 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-00b2e864-c5fc-4e88-a4ca-4495e4505c04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:27.114157 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-00b2e864-c5fc-4e88-a4ca-4495e4505c04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:27.114591 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-00b2e864-c5fc-4e88-a4ca-4495e4505c04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:27.240131 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-00b2e864-c5fc-4e88-a4ca-4495e4505c04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:27.247396 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-00b2e864-c5fc-4e88-a4ca-4495e4505c04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1263 microversion: 2.1 time: 0.145995 May 09 23:16:27.247953 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 499/1005] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:27 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:16:27.902891 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-ad25f1d0-e74d-4b5d-b7f6-15cae64835b9 req-051c4e7e-b8ae-42d2-a91e-f9cd0f73c452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b8028e-96dc-484d-926f-782a423ff712", "name": "network-vif-plugged", "status": "completed", "tag": "02457c86-3b08-41a7-b0ab-fc08377221ab"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:16:27.911540 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-ad25f1d0-e74d-4b5d-b7f6-15cae64835b9 req-051c4e7e-b8ae-42d2-a91e-f9cd0f73c452 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:27.912025 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-ad25f1d0-e74d-4b5d-b7f6-15cae64835b9 req-051c4e7e-b8ae-42d2-a91e-f9cd0f73c452 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:27.925659 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-ad25f1d0-e74d-4b5d-b7f6-15cae64835b9 req-051c4e7e-b8ae-42d2-a91e-f9cd0f73c452 service nova] Creating event network-vif-plugged:02457c86-3b08-41a7-b0ab-fc08377221ab for instance 91b8028e-96dc-484d-926f-782a423ff712 on hv-cinder-84067 May 09 23:16:27.930554 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-ad25f1d0-e74d-4b5d-b7f6-15cae64835b9 req-051c4e7e-b8ae-42d2-a91e-f9cd0f73c452 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031388 May 09 23:16:27.931145 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 507/1006] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:16:28.264629 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-21899ea2-6852-46f7-a655-cf93e262bc59 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:28.265245 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-21899ea2-6852-46f7-a655-cf93e262bc59 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:28.271634 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-21899ea2-6852-46f7-a655-cf93e262bc59 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:28.272085 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-21899ea2-6852-46f7-a655-cf93e262bc59 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:28.272855 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-21899ea2-6852-46f7-a655-cf93e262bc59 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:28.273286 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-21899ea2-6852-46f7-a655-cf93e262bc59 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:28.400681 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-21899ea2-6852-46f7-a655-cf93e262bc59 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:28.407818 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-21899ea2-6852-46f7-a655-cf93e262bc59 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1263 microversion: 2.1 time: 0.147117 May 09 23:16:28.408375 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 500/1007] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:28 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:16:29.426941 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-ad35f1fb-f032-4bed-b15f-10efab828f41 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:29.427576 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-ad35f1fb-f032-4bed-b15f-10efab828f41 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:29.433978 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad35f1fb-f032-4bed-b15f-10efab828f41 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:29.434797 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad35f1fb-f032-4bed-b15f-10efab828f41 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:29.435777 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad35f1fb-f032-4bed-b15f-10efab828f41 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:29.436382 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-ad35f1fb-f032-4bed-b15f-10efab828f41 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:29.582797 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-ad35f1fb-f032-4bed-b15f-10efab828f41 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:29.590276 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-ad35f1fb-f032-4bed-b15f-10efab828f41 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1263 microversion: 2.1 time: 0.168639 May 09 23:16:29.591028 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 508/1008] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:29 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:16:30.608122 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-aa7b3219-07ff-4cf0-8abb-414b8e067c27 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:30.608739 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-aa7b3219-07ff-4cf0-8abb-414b8e067c27 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:30.616413 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-aa7b3219-07ff-4cf0-8abb-414b8e067c27 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:30.616868 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-aa7b3219-07ff-4cf0-8abb-414b8e067c27 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:30.617651 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-aa7b3219-07ff-4cf0-8abb-414b8e067c27 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:30.618090 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-aa7b3219-07ff-4cf0-8abb-414b8e067c27 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:30.834100 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-aa7b3219-07ff-4cf0-8abb-414b8e067c27 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:30.841526 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-aa7b3219-07ff-4cf0-8abb-414b8e067c27 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1450 microversion: 2.1 time: 0.237583 May 09 23:16:30.842103 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 501/1009] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:30 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1450 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:16:30.858794 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-fe7cb78c-ccf8-4830-a08f-487857174af1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:16:30.859422 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-fe7cb78c-ccf8-4830-a08f-487857174af1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:16:30.865648 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fe7cb78c-ccf8-4830-a08f-487857174af1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:30.866091 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fe7cb78c-ccf8-4830-a08f-487857174af1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:30.866884 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fe7cb78c-ccf8-4830-a08f-487857174af1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:30.867316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-fe7cb78c-ccf8-4830-a08f-487857174af1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:31.001174 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-fe7cb78c-ccf8-4830-a08f-487857174af1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:16:31.012948 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-fe7cb78c-ccf8-4830-a08f-487857174af1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1450 microversion: 2.1 time: 0.157942 May 09 23:16:31.014960 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 509/1010] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:16:30 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:16:32.662277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-d42956c6-53e9-494f-8d67-4c307ee8ef27 req-94dc9994-a82c-4d11-a039-ad04326f2260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b8028e-96dc-484d-926f-782a423ff712", "tag": "02457c86-3b08-41a7-b0ab-fc08377221ab"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:16:32.670979 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-d42956c6-53e9-494f-8d67-4c307ee8ef27 req-94dc9994-a82c-4d11-a039-ad04326f2260 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:16:32.671543 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-d42956c6-53e9-494f-8d67-4c307ee8ef27 req-94dc9994-a82c-4d11-a039-ad04326f2260 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:16:32.683647 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-d42956c6-53e9-494f-8d67-4c307ee8ef27 req-94dc9994-a82c-4d11-a039-ad04326f2260 service nova] Creating event network-changed:02457c86-3b08-41a7-b0ab-fc08377221ab for instance 91b8028e-96dc-484d-926f-782a423ff712 on hv-cinder-84067 May 09 23:16:32.688921 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-d42956c6-53e9-494f-8d67-4c307ee8ef27 req-94dc9994-a82c-4d11-a039-ad04326f2260 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030898 May 09 23:16:32.689716 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 502/1011] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:17:22.959733 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:17:22.960415 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Mon May 9 23:17:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 23:18:28.834974 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e263b957-a259-4c0e-a18e-16bc1921c013] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 09 23:18:28.838510 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e33e610e-eb0b-4de4-ab83-9a919c95c8c0 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:28.839008 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e33e610e-eb0b-4de4-ab83-9a919c95c8c0 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:28.844934 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e33e610e-eb0b-4de4-ab83-9a919c95c8c0 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:28.845382 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e33e610e-eb0b-4de4-ab83-9a919c95c8c0 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:28.846171 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e33e610e-eb0b-4de4-ab83-9a919c95c8c0 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:28.846612 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e33e610e-eb0b-4de4-ab83-9a919c95c8c0 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:28.870532 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e33e610e-eb0b-4de4-ab83-9a919c95c8c0 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Going to try to terminate instance {{(pid=117143) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:18:28.949534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e33e610e-eb0b-4de4-ab83-9a919c95c8c0 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 204 len: 0 microversion: 2.1 time: 0.117103 May 09 23:18:28.950032 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 510/1012] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:18:28 2022] DELETE /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:18:28.956772 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b831d8d0-16d0-486f-a31f-a56439e32e5e] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 09 23:18:28.961128 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-144a75a7-8024-4807-ad0f-89414cd0620e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:28.961823 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-144a75a7-8024-4807-ad0f-89414cd0620e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:28.968549 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-144a75a7-8024-4807-ad0f-89414cd0620e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:28.968992 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-144a75a7-8024-4807-ad0f-89414cd0620e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:28.969781 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-144a75a7-8024-4807-ad0f-89414cd0620e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:28.970250 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-144a75a7-8024-4807-ad0f-89414cd0620e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:29.150763 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-144a75a7-8024-4807-ad0f-89414cd0620e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:29.158110 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-144a75a7-8024-4807-ad0f-89414cd0620e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1574 microversion: 2.1 time: 0.203479 May 09 23:18:29.158696 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 503/1013] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:28 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1574 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:30.176910 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-86d8af7d-d637-4fa6-b01e-e53ffc160c26 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:30.178234 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-86d8af7d-d637-4fa6-b01e-e53ffc160c26 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:30.185584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-86d8af7d-d637-4fa6-b01e-e53ffc160c26 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:30.186033 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-86d8af7d-d637-4fa6-b01e-e53ffc160c26 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:30.186853 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-86d8af7d-d637-4fa6-b01e-e53ffc160c26 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:30.187287 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-86d8af7d-d637-4fa6-b01e-e53ffc160c26 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:30.192380 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO oslo.messaging._drivers.impl_rabbit [-] [e263b957-a259-4c0e-a18e-16bc1921c013] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58548. May 09 23:18:30.366628 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-86d8af7d-d637-4fa6-b01e-e53ffc160c26 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:30.373970 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-86d8af7d-d637-4fa6-b01e-e53ffc160c26 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1574 microversion: 2.1 time: 0.201527 May 09 23:18:30.374566 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 511/1014] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:30 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1574 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:31.392844 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-df65dcf2-71cb-45a7-9cda-e8231ab7f2c3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:31.393502 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-df65dcf2-71cb-45a7-9cda-e8231ab7f2c3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:31.402592 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-df65dcf2-71cb-45a7-9cda-e8231ab7f2c3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:31.403043 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-df65dcf2-71cb-45a7-9cda-e8231ab7f2c3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:31.403821 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-df65dcf2-71cb-45a7-9cda-e8231ab7f2c3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:31.404257 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-df65dcf2-71cb-45a7-9cda-e8231ab7f2c3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:31.423494 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO oslo.messaging._drivers.impl_rabbit [-] [b831d8d0-16d0-486f-a31f-a56439e32e5e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58558. May 09 23:18:31.640747 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-df65dcf2-71cb-45a7-9cda-e8231ab7f2c3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:31.648602 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-df65dcf2-71cb-45a7-9cda-e8231ab7f2c3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 200 len: 1574 microversion: 2.1 time: 0.259681 May 09 23:18:31.649161 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 504/1015] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:31 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 1574 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:31.863666 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-d84b1280-9a76-4cff-84c2-fed6eb497ddb req-c877d7ad-cdeb-441e-971d-013db626133a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b8028e-96dc-484d-926f-782a423ff712", "name": "network-vif-deleted", "tag": "02457c86-3b08-41a7-b0ab-fc08377221ab"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:18:31.874344 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-d84b1280-9a76-4cff-84c2-fed6eb497ddb req-c877d7ad-cdeb-441e-971d-013db626133a service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:31.874980 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-d84b1280-9a76-4cff-84c2-fed6eb497ddb req-c877d7ad-cdeb-441e-971d-013db626133a service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:31.893689 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-d84b1280-9a76-4cff-84c2-fed6eb497ddb req-c877d7ad-cdeb-441e-971d-013db626133a service nova] Creating event network-vif-deleted:02457c86-3b08-41a7-b0ab-fc08377221ab for instance 91b8028e-96dc-484d-926f-782a423ff712 on hv-cinder-84067 May 09 23:18:31.899477 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-d84b1280-9a76-4cff-84c2-fed6eb497ddb req-c877d7ad-cdeb-441e-971d-013db626133a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039332 May 09 23:18:31.900290 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 512/1016] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:18:32.665834 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fbffa870-8c42-42b5-9574-0bbe5d485ae2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:32.667049 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-fbffa870-8c42-42b5-9574-0bbe5d485ae2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:32.673957 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fbffa870-8c42-42b5-9574-0bbe5d485ae2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:32.674689 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fbffa870-8c42-42b5-9574-0bbe5d485ae2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:32.675409 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fbffa870-8c42-42b5-9574-0bbe5d485ae2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:32.675845 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-fbffa870-8c42-42b5-9574-0bbe5d485ae2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:32.692787 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-fbffa870-8c42-42b5-9574-0bbe5d485ae2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] HTTP exception thrown: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fbffa870-8c42-42b5-9574-0bbe5d485ae2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Request method failure captured: May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 HTTP/1.1 May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieaCoH59VIUV-sqODYiTP511Qxznk7QJ_WtplsVxpf5rqNvJ3YLktf1JIBlZsVvWSinGwffoMgLhyXNvldwDLf_6MizUVxxt3VRUSgJMI9PkczfKNYjcrpx00y0-XnY-A3Co0rk-wOH-k9fVHaGSalER0T3c5_RlHtDMwOkF9uNenFmU May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: d557435c4af9467999e66a94c6929e11 May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-TestVolumeBootPattern-1592477090 May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:18:32.694471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:18:32.696213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d557435c4af9467999e66a94c6929e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d557435c4af9467999e66a94c6929e11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d557435c4af9467999e66a94c6929e11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d557435c4af9467999e66a94c6929e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:18:32.696213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-TestVolumeBootPattern-1592477090 May 09 23:18:32.696213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: d557435c4af9467999e66a94c6929e11 May 09 23:18:32.696213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-TestVolumeBootPattern-1592477090 May 09 23:18:32.696213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-TestVolumeBootPattern-1592477090-project May 09 23:18:32.696213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:18:32.696213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:18:32.696213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 069d3a8dd790459db3bcfea55f8e19f4 May 09 23:18:32.696213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-TestVolumeBootPattern-1592477090-project May 09 23:18:32.696213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:18:32.696213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:18:32.696213 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '91b8028e-96dc-484d-926f-782a423ff712'} May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:18:32.697234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:18:32.698872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:18:32.700954 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-fbffa870-8c42-42b5-9574-0bbe5d485ae2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Returning 404 to user: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:18:32.700954 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-fbffa870-8c42-42b5-9574-0bbe5d485ae2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 404 len: 111 microversion: 2.1 time: 0.034727 May 09 23:18:32.704718 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 505/1017] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:32 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:18:32.750194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1867533797", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-354173559", "security_groups": [{"name": "tempest-secgroup-smoke-40112821"}], "block_device_mapping_v2": [{"uuid": "f4f4354c-7eeb-44cf-b1c7-17d63285a2da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6ac40a30-c19e-4dfc-b8a0-754027b1e1e5"}]}} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:18:32.860194 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.network.neutron [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] validate_networks() for [('6ac40a30-c19e-4dfc-b8a0-754027b1e1e5', None, None, None, None, None)] {{(pid=117143) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:18:33.215502 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Flavor limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:18:33.216088 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Image limits 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:18:33.216384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Flavor pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:18:33.216790 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Image pref 0:0:0 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:18:33.217197 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.virt.hardware [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:18:33.226256 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:33.226704 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:33.227513 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:33.227949 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:33.244576 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Getting quotas for project d557435c4af9467999e66a94c6929e11. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:18:33.248375 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.quota [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Getting quotas for user 069d3a8dd790459db3bcfea55f8e19f4 and project d557435c4af9467999e66a94c6929e11. Resources: {'ram', 'cores', 'instances'} {{(pid=117143) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:18:33.303594 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Going to run 1 instances... {{(pid=117143) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:18:33.305762 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f4f4354c-7eeb-44cf-b1c7-17d63285a2da',volume_size=None,volume_type=None)] {{(pid=117143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:18:33.430986 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-9f7a414c-0df9-4664-980d-c71845e5327e tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.685256 May 09 23:18:33.431636 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 513/1018] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:18:32 2022] POST /compute/v2.1/servers => generated 404 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:18:33.441570 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d6f0a50f-c8d4-4bab-b5e1-df44431d1882 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:33.442251 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-d6f0a50f-c8d4-4bab-b5e1-df44431d1882 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:33.500575 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-d6f0a50f-c8d4-4bab-b5e1-df44431d1882 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:33.508102 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d6f0a50f-c8d4-4bab-b5e1-df44431d1882 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1094 microversion: 2.1 time: 0.070401 May 09 23:18:33.508659 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 506/1019] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:33 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:34.524853 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c7f866f5-4708-4dfa-9269-b02e6b95f845 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:34.525584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c7f866f5-4708-4dfa-9269-b02e6b95f845 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:34.582429 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c7f866f5-4708-4dfa-9269-b02e6b95f845 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:34.588890 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c7f866f5-4708-4dfa-9269-b02e6b95f845 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1094 microversion: 2.1 time: 0.067990 May 09 23:18:34.589444 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 514/1020] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:34 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:35.605313 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-e3952bfc-f7d2-45cd-af24-896de5cb61a8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:35.606025 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-e3952bfc-f7d2-45cd-af24-896de5cb61a8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:35.662598 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-e3952bfc-f7d2-45cd-af24-896de5cb61a8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:35.669050 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-e3952bfc-f7d2-45cd-af24-896de5cb61a8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1094 microversion: 2.1 time: 0.067819 May 09 23:18:35.669590 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 507/1021] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:35 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:36.686300 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6703c68f-e3df-4fdf-b41a-27322ad24881 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:36.686946 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6703c68f-e3df-4fdf-b41a-27322ad24881 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:36.743471 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6703c68f-e3df-4fdf-b41a-27322ad24881 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:36.749911 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6703c68f-e3df-4fdf-b41a-27322ad24881 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1094 microversion: 2.1 time: 0.067472 May 09 23:18:36.750646 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 515/1022] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:36 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:37.766744 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-5ccfe21b-fc13-4413-a3f1-c2fbfcfdea48 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:37.767415 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-5ccfe21b-fc13-4413-a3f1-c2fbfcfdea48 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:37.774382 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5ccfe21b-fc13-4413-a3f1-c2fbfcfdea48 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:37.774838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5ccfe21b-fc13-4413-a3f1-c2fbfcfdea48 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:37.775609 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5ccfe21b-fc13-4413-a3f1-c2fbfcfdea48 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:37.776042 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-5ccfe21b-fc13-4413-a3f1-c2fbfcfdea48 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:37.839246 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-5ccfe21b-fc13-4413-a3f1-c2fbfcfdea48 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:37.853153 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-5ccfe21b-fc13-4413-a3f1-c2fbfcfdea48 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1144 microversion: 2.1 time: 0.089819 May 09 23:18:37.854039 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 508/1023] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:37 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:38.870048 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-4a5b93d0-381a-4551-97b7-555e6f4eb518 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:38.870761 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-4a5b93d0-381a-4551-97b7-555e6f4eb518 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:38.877672 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4a5b93d0-381a-4551-97b7-555e6f4eb518 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:38.878046 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4a5b93d0-381a-4551-97b7-555e6f4eb518 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:38.878851 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4a5b93d0-381a-4551-97b7-555e6f4eb518 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:38.879284 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4a5b93d0-381a-4551-97b7-555e6f4eb518 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:38.941637 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4a5b93d0-381a-4551-97b7-555e6f4eb518 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:38.949846 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-4a5b93d0-381a-4551-97b7-555e6f4eb518 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1210 microversion: 2.1 time: 0.083735 May 09 23:18:38.950455 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 516/1024] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:38 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:39.966631 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ade39c83-c88d-4422-8af4-6c2c9e8b64be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:39.967450 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ade39c83-c88d-4422-8af4-6c2c9e8b64be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:39.975010 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ade39c83-c88d-4422-8af4-6c2c9e8b64be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:39.975562 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ade39c83-c88d-4422-8af4-6c2c9e8b64be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:39.976451 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ade39c83-c88d-4422-8af4-6c2c9e8b64be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:39.976972 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ade39c83-c88d-4422-8af4-6c2c9e8b64be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:40.157357 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-41e7df79-189e-495d-99e5-34dcd07e6c22 req-e818e41a-2379-4e09-b9b1-7810a07cd4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4841e7-e622-4370-9645-e1dcac94d49f", "tag": "51927c54-b4c2-42df-8816-bce841fa71a5"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:18:40.169156 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-41e7df79-189e-495d-99e5-34dcd07e6c22 req-e818e41a-2379-4e09-b9b1-7810a07cd4b6 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:40.169900 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-41e7df79-189e-495d-99e5-34dcd07e6c22 req-e818e41a-2379-4e09-b9b1-7810a07cd4b6 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:40.184938 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-41e7df79-189e-495d-99e5-34dcd07e6c22 req-e818e41a-2379-4e09-b9b1-7810a07cd4b6 service nova] Creating event network-changed:51927c54-b4c2-42df-8816-bce841fa71a5 for instance 9c4841e7-e622-4370-9645-e1dcac94d49f on hv-cinder-84067 May 09 23:18:40.192709 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-41e7df79-189e-495d-99e5-34dcd07e6c22 req-e818e41a-2379-4e09-b9b1-7810a07cd4b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039354 May 09 23:18:40.196920 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ade39c83-c88d-4422-8af4-6c2c9e8b64be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:40.199309 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 517/1025] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:18:40.209950 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ade39c83-c88d-4422-8af4-6c2c9e8b64be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1264 microversion: 2.1 time: 0.247555 May 09 23:18:40.210560 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 509/1026] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:39 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:41.227229 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-008db6e1-f654-4e03-8dbe-89a4c082c124 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:41.228078 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-008db6e1-f654-4e03-8dbe-89a4c082c124 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:41.234957 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-008db6e1-f654-4e03-8dbe-89a4c082c124 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:41.235408 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-008db6e1-f654-4e03-8dbe-89a4c082c124 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:41.236187 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-008db6e1-f654-4e03-8dbe-89a4c082c124 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:41.236631 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-008db6e1-f654-4e03-8dbe-89a4c082c124 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:41.367143 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-008db6e1-f654-4e03-8dbe-89a4c082c124 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:41.374404 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-008db6e1-f654-4e03-8dbe-89a4c082c124 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1264 microversion: 2.1 time: 0.152067 May 09 23:18:41.374972 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 518/1027] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:41 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:42.391277 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-69356c6b-9711-4146-a011-af204cee45ee tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:42.391881 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-69356c6b-9711-4146-a011-af204cee45ee tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:42.398851 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-69356c6b-9711-4146-a011-af204cee45ee tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:42.399307 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-69356c6b-9711-4146-a011-af204cee45ee tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:42.400081 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-69356c6b-9711-4146-a011-af204cee45ee tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:42.400520 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-69356c6b-9711-4146-a011-af204cee45ee tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:42.530759 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-69356c6b-9711-4146-a011-af204cee45ee tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:42.538029 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-69356c6b-9711-4146-a011-af204cee45ee tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1264 microversion: 2.1 time: 0.150651 May 09 23:18:42.538628 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 510/1028] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:42 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:43.555416 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-359c240b-0d35-4b71-a662-7527c9bcc426 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:43.556030 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-359c240b-0d35-4b71-a662-7527c9bcc426 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:43.562415 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-359c240b-0d35-4b71-a662-7527c9bcc426 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:43.562868 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-359c240b-0d35-4b71-a662-7527c9bcc426 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:43.563638 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-359c240b-0d35-4b71-a662-7527c9bcc426 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:43.564076 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-359c240b-0d35-4b71-a662-7527c9bcc426 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:43.693789 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-359c240b-0d35-4b71-a662-7527c9bcc426 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:43.701051 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-359c240b-0d35-4b71-a662-7527c9bcc426 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1264 microversion: 2.1 time: 0.150020 May 09 23:18:43.701631 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 519/1029] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:43 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:44.718441 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-8c1dfd4d-07eb-41f1-98e9-35272721c5ca tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:44.719041 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-8c1dfd4d-07eb-41f1-98e9-35272721c5ca tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:44.725850 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8c1dfd4d-07eb-41f1-98e9-35272721c5ca tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:44.726342 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8c1dfd4d-07eb-41f1-98e9-35272721c5ca tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:44.727102 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8c1dfd4d-07eb-41f1-98e9-35272721c5ca tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:44.727528 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8c1dfd4d-07eb-41f1-98e9-35272721c5ca tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:44.855743 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-8c1dfd4d-07eb-41f1-98e9-35272721c5ca tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:44.862930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-8c1dfd4d-07eb-41f1-98e9-35272721c5ca tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1264 microversion: 2.1 time: 0.148419 May 09 23:18:44.863495 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 511/1030] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:44 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:45.880337 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-31f6c734-dec7-4ad0-9847-a03cf646eeaa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:45.880890 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-31f6c734-dec7-4ad0-9847-a03cf646eeaa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:45.887835 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31f6c734-dec7-4ad0-9847-a03cf646eeaa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:45.888283 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31f6c734-dec7-4ad0-9847-a03cf646eeaa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:45.889051 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31f6c734-dec7-4ad0-9847-a03cf646eeaa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:45.889487 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31f6c734-dec7-4ad0-9847-a03cf646eeaa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:46.016021 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-31f6c734-dec7-4ad0-9847-a03cf646eeaa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:46.023736 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-31f6c734-dec7-4ad0-9847-a03cf646eeaa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1264 microversion: 2.1 time: 0.147368 May 09 23:18:46.024307 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 520/1031] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:45 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:47.044861 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-30c52e1f-119f-48ff-9bdc-cd3e1719f8d1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:47.045480 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-30c52e1f-119f-48ff-9bdc-cd3e1719f8d1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:47.051904 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-30c52e1f-119f-48ff-9bdc-cd3e1719f8d1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:47.052355 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-30c52e1f-119f-48ff-9bdc-cd3e1719f8d1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:47.053141 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-30c52e1f-119f-48ff-9bdc-cd3e1719f8d1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:47.053583 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-30c52e1f-119f-48ff-9bdc-cd3e1719f8d1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:47.186643 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-30c52e1f-119f-48ff-9bdc-cd3e1719f8d1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:47.195017 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-30c52e1f-119f-48ff-9bdc-cd3e1719f8d1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1264 microversion: 2.1 time: 0.158360 May 09 23:18:47.195577 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 512/1032] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:47 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:48.211335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-6dc1bca4-315f-4a38-8202-1eb743ab5a80 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:48.211979 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-6dc1bca4-315f-4a38-8202-1eb743ab5a80 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:48.218596 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6dc1bca4-315f-4a38-8202-1eb743ab5a80 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:48.219095 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6dc1bca4-315f-4a38-8202-1eb743ab5a80 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:48.219876 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6dc1bca4-315f-4a38-8202-1eb743ab5a80 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:48.220313 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-6dc1bca4-315f-4a38-8202-1eb743ab5a80 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:48.347106 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-6dc1bca4-315f-4a38-8202-1eb743ab5a80 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:48.355184 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-6dc1bca4-315f-4a38-8202-1eb743ab5a80 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1264 microversion: 2.1 time: 0.147681 May 09 23:18:48.355751 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 521/1033] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:48 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:49.373729 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-352f2ecc-4e4d-4e37-92d0-651c4b8d898f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:49.374376 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-352f2ecc-4e4d-4e37-92d0-651c4b8d898f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:49.381256 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-352f2ecc-4e4d-4e37-92d0-651c4b8d898f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:49.381712 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-352f2ecc-4e4d-4e37-92d0-651c4b8d898f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:49.382516 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-352f2ecc-4e4d-4e37-92d0-651c4b8d898f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:49.382934 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-352f2ecc-4e4d-4e37-92d0-651c4b8d898f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:49.511605 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-352f2ecc-4e4d-4e37-92d0-651c4b8d898f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:49.518947 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-352f2ecc-4e4d-4e37-92d0-651c4b8d898f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1264 microversion: 2.1 time: 0.149093 May 09 23:18:49.519519 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 513/1034] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:49 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:50.534749 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a38572a5-c4a6-4624-ac85-a78df3eb7ef8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:50.535388 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a38572a5-c4a6-4624-ac85-a78df3eb7ef8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:50.542241 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a38572a5-c4a6-4624-ac85-a78df3eb7ef8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:50.542747 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a38572a5-c4a6-4624-ac85-a78df3eb7ef8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:50.543523 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a38572a5-c4a6-4624-ac85-a78df3eb7ef8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:50.543965 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a38572a5-c4a6-4624-ac85-a78df3eb7ef8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:50.570252 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-5172d0ae-b957-4305-a7cf-e276235c2d47 req-8ea824d4-1c0f-4836-bbb2-3b3813fbaea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4841e7-e622-4370-9645-e1dcac94d49f", "name": "network-vif-plugged", "status": "completed", "tag": "51927c54-b4c2-42df-8816-bce841fa71a5"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:18:50.578773 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-5172d0ae-b957-4305-a7cf-e276235c2d47 req-8ea824d4-1c0f-4836-bbb2-3b3813fbaea0 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:50.579218 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-5172d0ae-b957-4305-a7cf-e276235c2d47 req-8ea824d4-1c0f-4836-bbb2-3b3813fbaea0 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:50.591668 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-5172d0ae-b957-4305-a7cf-e276235c2d47 req-8ea824d4-1c0f-4836-bbb2-3b3813fbaea0 service nova] Creating event network-vif-plugged:51927c54-b4c2-42df-8816-bce841fa71a5 for instance 9c4841e7-e622-4370-9645-e1dcac94d49f on hv-cinder-84067 May 09 23:18:50.595234 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR oslo.messaging._drivers.impl_rabbit [req-5172d0ae-b957-4305-a7cf-e276235c2d47 req-8ea824d4-1c0f-4836-bbb2-3b3813fbaea0 service nova] [64692d29-c2e2-4ccb-afb4-9a41f54c04cb] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 09 23:18:50.683105 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a38572a5-c4a6-4624-ac85-a78df3eb7ef8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:50.690474 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a38572a5-c4a6-4624-ac85-a78df3eb7ef8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1264 microversion: 2.1 time: 0.159635 May 09 23:18:50.691043 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 522/1035] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:50 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:51.602065 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO oslo.messaging._drivers.impl_rabbit [req-5172d0ae-b957-4305-a7cf-e276235c2d47 req-8ea824d4-1c0f-4836-bbb2-3b3813fbaea0 service nova] [64692d29-c2e2-4ccb-afb4-9a41f54c04cb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58636. May 09 23:18:51.605428 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-5172d0ae-b957-4305-a7cf-e276235c2d47 req-8ea824d4-1c0f-4836-bbb2-3b3813fbaea0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.039140 May 09 23:18:51.606033 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 514/1036] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:18:51.707609 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-bee9e583-951b-4a6d-8679-a0de98a7c9b3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:51.708316 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-bee9e583-951b-4a6d-8679-a0de98a7c9b3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:51.714549 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bee9e583-951b-4a6d-8679-a0de98a7c9b3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:51.715005 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bee9e583-951b-4a6d-8679-a0de98a7c9b3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:51.715785 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bee9e583-951b-4a6d-8679-a0de98a7c9b3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:51.716231 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-bee9e583-951b-4a6d-8679-a0de98a7c9b3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:51.852879 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-bee9e583-951b-4a6d-8679-a0de98a7c9b3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:51.860693 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-bee9e583-951b-4a6d-8679-a0de98a7c9b3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1264 microversion: 2.1 time: 0.157925 May 09 23:18:51.861276 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 523/1037] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:51 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:52.883161 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-87975d72-25fb-4273-b60e-421699f58818 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:52.884027 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-87975d72-25fb-4273-b60e-421699f58818 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:52.890636 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-87975d72-25fb-4273-b60e-421699f58818 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:52.891077 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-87975d72-25fb-4273-b60e-421699f58818 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:52.891838 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-87975d72-25fb-4273-b60e-421699f58818 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:52.892268 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-87975d72-25fb-4273-b60e-421699f58818 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:53.022318 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-87975d72-25fb-4273-b60e-421699f58818 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:53.029549 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-87975d72-25fb-4273-b60e-421699f58818 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1264 microversion: 2.1 time: 0.153172 May 09 23:18:53.030163 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 515/1038] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:52 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:54.046901 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-173ad85d-b416-49e4-98cc-8da4e2116ced tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:54.047518 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-173ad85d-b416-49e4-98cc-8da4e2116ced tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:54.053838 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-173ad85d-b416-49e4-98cc-8da4e2116ced tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:54.054325 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-173ad85d-b416-49e4-98cc-8da4e2116ced tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:54.055098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-173ad85d-b416-49e4-98cc-8da4e2116ced tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:54.055534 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-173ad85d-b416-49e4-98cc-8da4e2116ced tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:54.184223 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-173ad85d-b416-49e4-98cc-8da4e2116ced tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:54.191524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-173ad85d-b416-49e4-98cc-8da4e2116ced tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1452 microversion: 2.1 time: 0.148452 May 09 23:18:54.192098 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 524/1039] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:54 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:54.207837 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-a238045c-ae45-4d99-91d4-0841216780b9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:18:54.209039 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-a238045c-ae45-4d99-91d4-0841216780b9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:18:54.215303 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a238045c-ae45-4d99-91d4-0841216780b9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:54.215764 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a238045c-ae45-4d99-91d4-0841216780b9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:54.216530 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a238045c-ae45-4d99-91d4-0841216780b9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:54.216963 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-a238045c-ae45-4d99-91d4-0841216780b9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:54.346266 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-a238045c-ae45-4d99-91d4-0841216780b9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:18:54.353856 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-a238045c-ae45-4d99-91d4-0841216780b9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1452 microversion: 2.1 time: 0.149580 May 09 23:18:54.354472 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 516/1040] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:18:54 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:18:56.220564 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [req-7f177a3c-aeaa-4ea8-91a2-2379f4f9aee9 req-04c4d100-f4b5-45fb-a8e2-9bd915663989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4841e7-e622-4370-9645-e1dcac94d49f", "tag": "51927c54-b4c2-42df-8816-bce841fa71a5"}]} {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:18:56.229516 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-7f177a3c-aeaa-4ea8-91a2-2379f4f9aee9 req-04c4d100-f4b5-45fb-a8e2-9bd915663989 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:18:56.229950 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [req-7f177a3c-aeaa-4ea8-91a2-2379f4f9aee9 req-04c4d100-f4b5-45fb-a8e2-9bd915663989 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:18:56.241017 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.compute.server_external_events [req-7f177a3c-aeaa-4ea8-91a2-2379f4f9aee9 req-04c4d100-f4b5-45fb-a8e2-9bd915663989 service nova] Creating event network-changed:51927c54-b4c2-42df-8816-bce841fa71a5 for instance 9c4841e7-e622-4370-9645-e1dcac94d49f on hv-cinder-84067 May 09 23:18:56.246214 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [req-7f177a3c-aeaa-4ea8-91a2-2379f4f9aee9 req-04c4d100-f4b5-45fb-a8e2-9bd915663989 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029207 May 09 23:18:56.247305 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 525/1041] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:19:05.441645 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:19:05.442248 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Mon May 9 23:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 23:20:30.316304 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1506052950", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-354173559", "security_groups": [{"name": "tempest-secgroup-smoke-40112821"}], "block_device_mapping_v2": [{"uuid": "d33be094-6b4f-4ef6-bca8-2f25f30fa722", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6ac40a30-c19e-4dfc-b8a0-754027b1e1e5"}]}} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:20:30.435126 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.network.neutron [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] validate_networks() for [('6ac40a30-c19e-4dfc-b8a0-754027b1e1e5', None, None, None, None, None)] {{(pid=117142) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 23:20:30.846070 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Flavor limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 23:20:30.846535 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Image limits 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 23:20:30.847008 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Flavor pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 23:20:30.847413 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Image pref 0:0:0 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 23:20:30.847843 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.virt.hardware [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 23:20:30.857112 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:30.857559 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:30.858387 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:30.858821 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:30.875309 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Getting quotas for project d557435c4af9467999e66a94c6929e11. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 23:20:30.879149 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.quota [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Getting quotas for user 069d3a8dd790459db3bcfea55f8e19f4 and project d557435c4af9467999e66a94c6929e11. Resources: {'ram', 'cores', 'instances'} {{(pid=117142) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 23:20:30.936580 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Going to run 1 instances... {{(pid=117142) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 23:20:30.938717 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d33be094-6b4f-4ef6-bca8-2f25f30fa722',volume_size=None,volume_type=None)] {{(pid=117142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 23:20:31.056906 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [fea75a76-3550-4110-ab49-63353f00ed59] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 09 23:20:32.063004 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO oslo.messaging._drivers.impl_rabbit [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [fea75a76-3550-4110-ab49-63353f00ed59] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58730. May 09 23:20:32.067206 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c95ffd80-9fc5-4124-9d18-7c1640880be9 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.756013 May 09 23:20:32.067836 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 517/1042] 10.222.0.23 () {60 vars in 1146 bytes} [Mon May 9 23:20:30 2022] POST /compute/v2.1/servers => generated 404 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 23:20:32.077624 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e263b957-a259-4c0e-a18e-16bc1921c013] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 09 23:20:32.081664 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b4716c28-26ff-4e29-a4ae-f2bb6a5a05c1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:32.082384 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b4716c28-26ff-4e29-a4ae-f2bb6a5a05c1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:32.143878 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b4716c28-26ff-4e29-a4ae-f2bb6a5a05c1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:32.151239 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b4716c28-26ff-4e29-a4ae-f2bb6a5a05c1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1094 microversion: 2.1 time: 0.076470 May 09 23:20:32.151819 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 526/1043] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:32 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:20:33.169209 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-9b6a285e-dad8-4fa9-9adc-5a987571eafe tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:33.169826 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-9b6a285e-dad8-4fa9-9adc-5a987571eafe tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:33.176123 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9b6a285e-dad8-4fa9-9adc-5a987571eafe tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:33.176577 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9b6a285e-dad8-4fa9-9adc-5a987571eafe tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:33.177455 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9b6a285e-dad8-4fa9-9adc-5a987571eafe tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:33.178448 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-9b6a285e-dad8-4fa9-9adc-5a987571eafe tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:33.251054 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-9b6a285e-dad8-4fa9-9adc-5a987571eafe tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:33.258523 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-9b6a285e-dad8-4fa9-9adc-5a987571eafe tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1210 microversion: 2.1 time: 0.093719 May 09 23:20:33.259209 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 518/1044] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:33 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:20:34.275836 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-344f3fad-5d3f-4c29-8438-dc84dc8a7e1f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:34.276454 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-344f3fad-5d3f-4c29-8438-dc84dc8a7e1f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:34.285956 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-344f3fad-5d3f-4c29-8438-dc84dc8a7e1f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:34.286833 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-344f3fad-5d3f-4c29-8438-dc84dc8a7e1f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:34.287703 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-344f3fad-5d3f-4c29-8438-dc84dc8a7e1f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:34.288157 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-344f3fad-5d3f-4c29-8438-dc84dc8a7e1f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:34.300532 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO oslo.messaging._drivers.impl_rabbit [-] [e263b957-a259-4c0e-a18e-16bc1921c013] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58752. May 09 23:20:34.446159 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-344f3fad-5d3f-4c29-8438-dc84dc8a7e1f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:34.454311 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-51443d14-b57d-4921-bc58-57ca76bfeda2 req-33c555bb-94e5-4473-8a4d-4940474cad9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93000c5e-ed5b-4f23-8168-88b9bbde91af", "tag": "43c19e39-e73a-4238-a28b-c0adeaa90b26"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:20:34.455750 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-344f3fad-5d3f-4c29-8438-dc84dc8a7e1f tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1264 microversion: 2.1 time: 0.183658 May 09 23:20:34.456342 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 527/1045] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:34 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:20:34.464359 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-51443d14-b57d-4921-bc58-57ca76bfeda2 req-33c555bb-94e5-4473-8a4d-4940474cad9f service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:34.464803 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-51443d14-b57d-4921-bc58-57ca76bfeda2 req-33c555bb-94e5-4473-8a4d-4940474cad9f service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:34.481685 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-51443d14-b57d-4921-bc58-57ca76bfeda2 req-33c555bb-94e5-4473-8a4d-4940474cad9f service nova] Creating event network-changed:43c19e39-e73a-4238-a28b-c0adeaa90b26 for instance 93000c5e-ed5b-4f23-8168-88b9bbde91af on hv-cinder-84067 May 09 23:20:34.486895 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-51443d14-b57d-4921-bc58-57ca76bfeda2 req-33c555bb-94e5-4473-8a4d-4940474cad9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037154 May 09 23:20:34.488027 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 519/1046] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 23:20:35.473980 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b629525d-2dec-40fd-b5eb-e955fbb8f760 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:35.475130 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b629525d-2dec-40fd-b5eb-e955fbb8f760 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:35.481672 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b629525d-2dec-40fd-b5eb-e955fbb8f760 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:35.482134 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b629525d-2dec-40fd-b5eb-e955fbb8f760 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:35.482930 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b629525d-2dec-40fd-b5eb-e955fbb8f760 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:35.483365 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b629525d-2dec-40fd-b5eb-e955fbb8f760 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:35.617811 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-b629525d-2dec-40fd-b5eb-e955fbb8f760 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:35.625490 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b629525d-2dec-40fd-b5eb-e955fbb8f760 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1264 microversion: 2.1 time: 0.155861 May 09 23:20:35.630244 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 528/1047] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:35 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:20:36.643325 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c65959cc-852d-48af-90a4-3c4506b629a7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:36.644063 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c65959cc-852d-48af-90a4-3c4506b629a7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:36.650327 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c65959cc-852d-48af-90a4-3c4506b629a7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:36.650780 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c65959cc-852d-48af-90a4-3c4506b629a7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:36.651551 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c65959cc-852d-48af-90a4-3c4506b629a7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:36.651989 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c65959cc-852d-48af-90a4-3c4506b629a7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:36.781124 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c65959cc-852d-48af-90a4-3c4506b629a7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:36.788923 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c65959cc-852d-48af-90a4-3c4506b629a7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1264 microversion: 2.1 time: 0.150243 May 09 23:20:36.789490 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 520/1048] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:36 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:20:37.805924 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a3da5f43-f032-4cfe-a239-e43834844742 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:37.806568 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a3da5f43-f032-4cfe-a239-e43834844742 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:37.812851 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a3da5f43-f032-4cfe-a239-e43834844742 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:37.813303 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a3da5f43-f032-4cfe-a239-e43834844742 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:37.814069 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a3da5f43-f032-4cfe-a239-e43834844742 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:37.814537 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a3da5f43-f032-4cfe-a239-e43834844742 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:37.946380 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a3da5f43-f032-4cfe-a239-e43834844742 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:37.953741 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a3da5f43-f032-4cfe-a239-e43834844742 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1264 microversion: 2.1 time: 0.152309 May 09 23:20:37.954340 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 529/1049] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:37 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:20:38.970907 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cdcc034e-a3ec-4d9d-a755-621af47d2212 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:38.971487 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cdcc034e-a3ec-4d9d-a755-621af47d2212 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:38.978493 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cdcc034e-a3ec-4d9d-a755-621af47d2212 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:38.978942 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cdcc034e-a3ec-4d9d-a755-621af47d2212 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:38.979706 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cdcc034e-a3ec-4d9d-a755-621af47d2212 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:38.980137 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cdcc034e-a3ec-4d9d-a755-621af47d2212 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:39.104214 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-cdcc034e-a3ec-4d9d-a755-621af47d2212 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:39.111407 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cdcc034e-a3ec-4d9d-a755-621af47d2212 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1264 microversion: 2.1 time: 0.144424 May 09 23:20:39.111964 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 521/1050] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:38 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1264 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:20:40.129020 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-0823dbd2-b35b-4364-bbd2-995cdbbe1d16 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:40.129639 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-0823dbd2-b35b-4364-bbd2-995cdbbe1d16 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:40.135946 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0823dbd2-b35b-4364-bbd2-995cdbbe1d16 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:40.136397 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0823dbd2-b35b-4364-bbd2-995cdbbe1d16 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:40.137174 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0823dbd2-b35b-4364-bbd2-995cdbbe1d16 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:40.137607 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-0823dbd2-b35b-4364-bbd2-995cdbbe1d16 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:40.272653 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-0823dbd2-b35b-4364-bbd2-995cdbbe1d16 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:40.280028 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-0823dbd2-b35b-4364-bbd2-995cdbbe1d16 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1264 microversion: 2.1 time: 0.154986 May 09 23:20:40.280607 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 530/1051] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:40 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:20:41.297379 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-056e1472-1a7b-4639-99c3-df7b50eb8552 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:41.297996 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-056e1472-1a7b-4639-99c3-df7b50eb8552 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:41.304344 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-056e1472-1a7b-4639-99c3-df7b50eb8552 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:41.304801 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-056e1472-1a7b-4639-99c3-df7b50eb8552 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:41.305577 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-056e1472-1a7b-4639-99c3-df7b50eb8552 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:41.306019 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-056e1472-1a7b-4639-99c3-df7b50eb8552 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:41.434498 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-056e1472-1a7b-4639-99c3-df7b50eb8552 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:41.441832 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-056e1472-1a7b-4639-99c3-df7b50eb8552 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1264 microversion: 2.1 time: 0.148297 May 09 23:20:41.442448 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 522/1052] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:41 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:20:42.459564 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-31520c84-d42e-46f8-b23b-52287abef967 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:42.460175 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-31520c84-d42e-46f8-b23b-52287abef967 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:42.466533 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31520c84-d42e-46f8-b23b-52287abef967 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:42.466985 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31520c84-d42e-46f8-b23b-52287abef967 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:42.467756 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31520c84-d42e-46f8-b23b-52287abef967 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:42.468191 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-31520c84-d42e-46f8-b23b-52287abef967 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:42.601358 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-31520c84-d42e-46f8-b23b-52287abef967 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:42.608784 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-31520c84-d42e-46f8-b23b-52287abef967 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1264 microversion: 2.1 time: 0.153610 May 09 23:20:42.609348 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 531/1053] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:42 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:20:43.625472 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c5664842-7f0f-4752-bdac-710a2d42e040 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:43.626145 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c5664842-7f0f-4752-bdac-710a2d42e040 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:43.632957 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c5664842-7f0f-4752-bdac-710a2d42e040 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:43.633404 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c5664842-7f0f-4752-bdac-710a2d42e040 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:43.634225 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c5664842-7f0f-4752-bdac-710a2d42e040 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:43.634671 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c5664842-7f0f-4752-bdac-710a2d42e040 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:43.761167 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c5664842-7f0f-4752-bdac-710a2d42e040 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:43.768470 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c5664842-7f0f-4752-bdac-710a2d42e040 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1264 microversion: 2.1 time: 0.147001 May 09 23:20:43.769032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 523/1054] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:43 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:20:44.784697 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-713f7a89-e207-4cd0-8ba1-89cd084d7ae1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:44.785332 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-713f7a89-e207-4cd0-8ba1-89cd084d7ae1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:44.791633 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-713f7a89-e207-4cd0-8ba1-89cd084d7ae1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:44.792080 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-713f7a89-e207-4cd0-8ba1-89cd084d7ae1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:44.792845 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-713f7a89-e207-4cd0-8ba1-89cd084d7ae1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:44.793279 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-713f7a89-e207-4cd0-8ba1-89cd084d7ae1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:44.921314 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-713f7a89-e207-4cd0-8ba1-89cd084d7ae1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:44.929145 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-713f7a89-e207-4cd0-8ba1-89cd084d7ae1 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1264 microversion: 2.1 time: 0.148294 May 09 23:20:44.929717 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 532/1055] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:44 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:20:45.213585 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-4f2e2912-7be4-4a49-a708-67a5c21dba3b req-830fab3e-62ae-4cbc-806a-9fec3fa9eded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93000c5e-ed5b-4f23-8168-88b9bbde91af", "name": "network-vif-plugged", "status": "completed", "tag": "43c19e39-e73a-4238-a28b-c0adeaa90b26"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:20:45.222450 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-4f2e2912-7be4-4a49-a708-67a5c21dba3b req-830fab3e-62ae-4cbc-806a-9fec3fa9eded service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:45.223253 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-4f2e2912-7be4-4a49-a708-67a5c21dba3b req-830fab3e-62ae-4cbc-806a-9fec3fa9eded service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:45.234705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-4f2e2912-7be4-4a49-a708-67a5c21dba3b req-830fab3e-62ae-4cbc-806a-9fec3fa9eded service nova] Creating event network-vif-plugged:43c19e39-e73a-4238-a28b-c0adeaa90b26 for instance 93000c5e-ed5b-4f23-8168-88b9bbde91af on hv-cinder-84067 May 09 23:20:45.240240 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-4f2e2912-7be4-4a49-a708-67a5c21dba3b req-830fab3e-62ae-4cbc-806a-9fec3fa9eded service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084494 May 09 23:20:45.240817 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 524/1056] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:20:45.945444 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-4c19aafe-6603-4841-9089-7a2a32eec69a tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:45.946058 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-4c19aafe-6603-4841-9089-7a2a32eec69a tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:45.952371 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4c19aafe-6603-4841-9089-7a2a32eec69a tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:45.952820 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4c19aafe-6603-4841-9089-7a2a32eec69a tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:45.953582 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4c19aafe-6603-4841-9089-7a2a32eec69a tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:45.954016 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-4c19aafe-6603-4841-9089-7a2a32eec69a tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:46.079999 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-4c19aafe-6603-4841-9089-7a2a32eec69a tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:46.087329 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-4c19aafe-6603-4841-9089-7a2a32eec69a tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1264 microversion: 2.1 time: 0.145826 May 09 23:20:46.087900 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 533/1057] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:45 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:20:47.106019 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-c84dabd3-d77e-43ab-818b-7d079042f3e3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:47.106758 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-c84dabd3-d77e-43ab-818b-7d079042f3e3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:47.112755 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c84dabd3-d77e-43ab-818b-7d079042f3e3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:47.113207 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c84dabd3-d77e-43ab-818b-7d079042f3e3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:47.113977 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c84dabd3-d77e-43ab-818b-7d079042f3e3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:47.114468 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-c84dabd3-d77e-43ab-818b-7d079042f3e3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:47.241652 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-c84dabd3-d77e-43ab-818b-7d079042f3e3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:47.249011 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-c84dabd3-d77e-43ab-818b-7d079042f3e3 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1452 microversion: 2.1 time: 0.148989 May 09 23:20:47.249578 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 525/1058] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:47 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:20:47.265856 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-c0026e9d-bd5f-4194-8863-86ebd5199758 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:20:47.266494 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-c0026e9d-bd5f-4194-8863-86ebd5199758 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:20:47.273275 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c0026e9d-bd5f-4194-8863-86ebd5199758 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:47.273722 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c0026e9d-bd5f-4194-8863-86ebd5199758 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:47.274523 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c0026e9d-bd5f-4194-8863-86ebd5199758 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:47.274956 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-c0026e9d-bd5f-4194-8863-86ebd5199758 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:47.399697 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-c0026e9d-bd5f-4194-8863-86ebd5199758 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:20:47.407080 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-c0026e9d-bd5f-4194-8863-86ebd5199758 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1452 microversion: 2.1 time: 0.145014 May 09 23:20:47.407648 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 534/1059] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:20:47 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 23:20:49.361309 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-a93f14fa-8679-4bd4-a348-c92829176e1a req-6b1ca431-3244-4534-9114-219d4d5d3a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93000c5e-ed5b-4f23-8168-88b9bbde91af", "tag": "43c19e39-e73a-4238-a28b-c0adeaa90b26"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:20:49.369925 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-a93f14fa-8679-4bd4-a348-c92829176e1a req-6b1ca431-3244-4534-9114-219d4d5d3a28 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:20:49.370400 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-a93f14fa-8679-4bd4-a348-c92829176e1a req-6b1ca431-3244-4534-9114-219d4d5d3a28 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:20:49.382008 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-a93f14fa-8679-4bd4-a348-c92829176e1a req-6b1ca431-3244-4534-9114-219d4d5d3a28 service nova] Creating event network-changed:43c19e39-e73a-4238-a28b-c0adeaa90b26 for instance 93000c5e-ed5b-4f23-8168-88b9bbde91af on hv-cinder-84067 May 09 23:20:49.387168 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-a93f14fa-8679-4bd4-a348-c92829176e1a req-6b1ca431-3244-4534-9114-219d4d5d3a28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083069 May 09 23:20:49.387819 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 526/1060] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:20:58.226053 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:20:58.226571 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Mon May 9 23:20:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 23:21:09.964702 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:21:09.965289 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Mon May 9 23:21:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 23:22:18.589816 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-835dbaae-f9c7-4209-9bda-c99b5acb67be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:22:18.590523 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-835dbaae-f9c7-4209-9bda-c99b5acb67be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:22:18.593165 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-0dddcba2-9b07-4f77-907d-580f4d59a863 req-f5f9b26c-6a68-46d2-a415-d030ad4be98f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93000c5e-ed5b-4f23-8168-88b9bbde91af", "tag": "43c19e39-e73a-4238-a28b-c0adeaa90b26"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:22:18.596261 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-835dbaae-f9c7-4209-9bda-c99b5acb67be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:18.596711 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-835dbaae-f9c7-4209-9bda-c99b5acb67be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:18.598137 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-835dbaae-f9c7-4209-9bda-c99b5acb67be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:18.598578 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-835dbaae-f9c7-4209-9bda-c99b5acb67be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:18.603246 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-0dddcba2-9b07-4f77-907d-580f4d59a863 req-f5f9b26c-6a68-46d2-a415-d030ad4be98f service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:18.603689 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-0dddcba2-9b07-4f77-907d-580f4d59a863 req-f5f9b26c-6a68-46d2-a415-d030ad4be98f service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:18.617416 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-0dddcba2-9b07-4f77-907d-580f4d59a863 req-f5f9b26c-6a68-46d2-a415-d030ad4be98f service nova] Creating event network-changed:43c19e39-e73a-4238-a28b-c0adeaa90b26 for instance 93000c5e-ed5b-4f23-8168-88b9bbde91af on hv-cinder-84067 May 09 23:22:18.625340 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-835dbaae-f9c7-4209-9bda-c99b5acb67be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Going to try to terminate instance {{(pid=117143) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:22:18.627255 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-0dddcba2-9b07-4f77-907d-580f4d59a863 req-f5f9b26c-6a68-46d2-a415-d030ad4be98f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039568 May 09 23:22:18.627934 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 527/1061] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:22:18.710680 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-835dbaae-f9c7-4209-9bda-c99b5acb67be tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "DELETE /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 204 len: 0 microversion: 2.1 time: 0.125427 May 09 23:22:18.711564 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 535/1062] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:22:18 2022] DELETE /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:22:18.720578 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-8c38a26f-3de5-4f58-b54c-3132d1b97762 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:22:18.721303 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-8c38a26f-3de5-4f58-b54c-3132d1b97762 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:22:18.728425 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8c38a26f-3de5-4f58-b54c-3132d1b97762 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:18.728872 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8c38a26f-3de5-4f58-b54c-3132d1b97762 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:18.729868 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8c38a26f-3de5-4f58-b54c-3132d1b97762 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:18.730349 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-8c38a26f-3de5-4f58-b54c-3132d1b97762 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:18.900323 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-8c38a26f-3de5-4f58-b54c-3132d1b97762 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:22:18.907928 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-8c38a26f-3de5-4f58-b54c-3132d1b97762 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1577 microversion: 2.1 time: 0.191867 May 09 23:22:18.908705 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 528/1063] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:22:18 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:22:19.925806 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-5adb4da5-a97b-4889-ae2a-bba763972ffa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:22:19.926507 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-5adb4da5-a97b-4889-ae2a-bba763972ffa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:22:19.932888 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5adb4da5-a97b-4889-ae2a-bba763972ffa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:19.933339 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5adb4da5-a97b-4889-ae2a-bba763972ffa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:19.934105 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5adb4da5-a97b-4889-ae2a-bba763972ffa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:19.934569 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-5adb4da5-a97b-4889-ae2a-bba763972ffa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:20.066669 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-5adb4da5-a97b-4889-ae2a-bba763972ffa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:22:20.074053 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-5adb4da5-a97b-4889-ae2a-bba763972ffa tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1577 microversion: 2.1 time: 0.152572 May 09 23:22:20.074648 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 536/1064] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:22:19 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:22:20.963103 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-23a337c4-1bf5-45ed-bceb-faa1b5163159 req-40fdf7fb-17a3-4971-881a-315675651307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93000c5e-ed5b-4f23-8168-88b9bbde91af", "name": "network-vif-deleted", "tag": "43c19e39-e73a-4238-a28b-c0adeaa90b26"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:22:20.973215 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-23a337c4-1bf5-45ed-bceb-faa1b5163159 req-40fdf7fb-17a3-4971-881a-315675651307 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:20.973696 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-23a337c4-1bf5-45ed-bceb-faa1b5163159 req-40fdf7fb-17a3-4971-881a-315675651307 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:20.986231 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-23a337c4-1bf5-45ed-bceb-faa1b5163159 req-40fdf7fb-17a3-4971-881a-315675651307 service nova] Creating event network-vif-deleted:43c19e39-e73a-4238-a28b-c0adeaa90b26 for instance 93000c5e-ed5b-4f23-8168-88b9bbde91af on hv-cinder-84067 May 09 23:22:20.992104 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-23a337c4-1bf5-45ed-bceb-faa1b5163159 req-40fdf7fb-17a3-4971-881a-315675651307 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032589 May 09 23:22:20.992965 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 529/1065] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:22:21.091868 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-3d5e96fb-21b0-4c96-8d5d-ad108d38cfc7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:22:21.092484 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-3d5e96fb-21b0-4c96-8d5d-ad108d38cfc7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:22:21.099282 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3d5e96fb-21b0-4c96-8d5d-ad108d38cfc7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:21.099737 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3d5e96fb-21b0-4c96-8d5d-ad108d38cfc7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:21.100508 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3d5e96fb-21b0-4c96-8d5d-ad108d38cfc7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:21.100948 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-3d5e96fb-21b0-4c96-8d5d-ad108d38cfc7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:21.162742 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-3d5e96fb-21b0-4c96-8d5d-ad108d38cfc7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:22:21.170002 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-3d5e96fb-21b0-4c96-8d5d-ad108d38cfc7 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 200 len: 1225 microversion: 2.1 time: 0.081991 May 09 23:22:21.170601 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 537/1066] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:22:21 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:22:22.189060 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1aa80a2d-401e-4224-ba31-ea22e7a96af8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:22:22.189686 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-1aa80a2d-401e-4224-ba31-ea22e7a96af8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 93000c5e-ed5b-4f23-8168-88b9bbde91af] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:22:22.196309 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1aa80a2d-401e-4224-ba31-ea22e7a96af8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:22.196766 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1aa80a2d-401e-4224-ba31-ea22e7a96af8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:22.197542 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1aa80a2d-401e-4224-ba31-ea22e7a96af8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:22.197982 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-1aa80a2d-401e-4224-ba31-ea22e7a96af8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:22.211240 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-1aa80a2d-401e-4224-ba31-ea22e7a96af8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] HTTP exception thrown: Instance 93000c5e-ed5b-4f23-8168-88b9bbde91af could not be found. May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1aa80a2d-401e-4224-ba31-ea22e7a96af8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Request method failure captured: May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af HTTP/1.1 May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieaCoH59VIUV-sqODYiTP511Qxznk7QJ_WtplsVxpf5rqNvJ3YLktf1JIBlZsVvWSinGwffoMgLhyXNvldwDLf_6MizUVxxt3VRUSgJMI9PkczfKNYjcrpx00y0-XnY-A3Co0rk-wOH-k9fVHaGSalER0T3c5_RlHtDMwOkF9uNenFmU May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: d557435c4af9467999e66a94c6929e11 May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-TestVolumeBootPattern-1592477090 May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:22:22.212874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:22:22.214584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d557435c4af9467999e66a94c6929e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d557435c4af9467999e66a94c6929e11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d557435c4af9467999e66a94c6929e11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d557435c4af9467999e66a94c6929e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:22:22.214584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-TestVolumeBootPattern-1592477090 May 09 23:22:22.214584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: d557435c4af9467999e66a94c6929e11 May 09 23:22:22.214584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-TestVolumeBootPattern-1592477090 May 09 23:22:22.214584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-TestVolumeBootPattern-1592477090-project May 09 23:22:22.214584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:22:22.214584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:22:22.214584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 069d3a8dd790459db3bcfea55f8e19f4 May 09 23:22:22.214584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-TestVolumeBootPattern-1592477090-project May 09 23:22:22.214584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:22:22.214584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 93000c5e-ed5b-4f23-8168-88b9bbde91af could not be found. May 09 23:22:22.214584 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '93000c5e-ed5b-4f23-8168-88b9bbde91af'} May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93000c5e-ed5b-4f23-8168-88b9bbde91af could not be found. May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:22:22.215457 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93000c5e-ed5b-4f23-8168-88b9bbde91af could not be found. May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93000c5e-ed5b-4f23-8168-88b9bbde91af could not be found. May 09 23:22:22.217032 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:22.218567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-1aa80a2d-401e-4224-ba31-ea22e7a96af8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Returning 404 to user: Instance 93000c5e-ed5b-4f23-8168-88b9bbde91af could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:22:22.218567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-1aa80a2d-401e-4224-ba31-ea22e7a96af8 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af" status: 404 len: 111 microversion: 2.1 time: 0.029537 May 09 23:22:22.218567 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 530/1067] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:22:22 2022] GET /compute/v2.1/servers/93000c5e-ed5b-4f23-8168-88b9bbde91af => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:22:25.268271 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-c15d614d-792d-4b5d-b382-fa6f3f471765 req-830cf292-e28c-4a1a-ac4d-22c91ad6b14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4841e7-e622-4370-9645-e1dcac94d49f", "tag": "51927c54-b4c2-42df-8816-bce841fa71a5"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:22:25.271524 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-df7e2f9f-87d2-4c78-b1c5-1388e248ad24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:22:25.276181 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-df7e2f9f-87d2-4c78-b1c5-1388e248ad24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:22:25.282906 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-c15d614d-792d-4b5d-b382-fa6f3f471765 req-830cf292-e28c-4a1a-ac4d-22c91ad6b14f service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:25.283111 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-df7e2f9f-87d2-4c78-b1c5-1388e248ad24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:25.283352 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-df7e2f9f-87d2-4c78-b1c5-1388e248ad24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:25.283471 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-c15d614d-792d-4b5d-b382-fa6f3f471765 req-830cf292-e28c-4a1a-ac4d-22c91ad6b14f service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:25.284202 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-df7e2f9f-87d2-4c78-b1c5-1388e248ad24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:25.284661 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-df7e2f9f-87d2-4c78-b1c5-1388e248ad24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:25.294708 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-c15d614d-792d-4b5d-b382-fa6f3f471765 req-830cf292-e28c-4a1a-ac4d-22c91ad6b14f service nova] Creating event network-changed:51927c54-b4c2-42df-8816-bce841fa71a5 for instance 9c4841e7-e622-4370-9645-e1dcac94d49f on hv-cinder-84067 May 09 23:22:25.299823 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-c15d614d-792d-4b5d-b382-fa6f3f471765 req-830cf292-e28c-4a1a-ac4d-22c91ad6b14f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035171 May 09 23:22:25.300626 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 531/1068] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:22:25.311871 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-df7e2f9f-87d2-4c78-b1c5-1388e248ad24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Going to try to terminate instance {{(pid=117143) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 23:22:25.394577 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-df7e2f9f-87d2-4c78-b1c5-1388e248ad24 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 204 len: 0 microversion: 2.1 time: 0.132421 May 09 23:22:25.398510 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 538/1069] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:22:25 2022] DELETE /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 23:22:25.404031 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-ad5138e2-4dbc-46fa-92ca-374c9a405c33 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:22:25.405076 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-ad5138e2-4dbc-46fa-92ca-374c9a405c33 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:22:25.411554 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ad5138e2-4dbc-46fa-92ca-374c9a405c33 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:25.412216 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ad5138e2-4dbc-46fa-92ca-374c9a405c33 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:25.413712 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ad5138e2-4dbc-46fa-92ca-374c9a405c33 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:25.414337 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-ad5138e2-4dbc-46fa-92ca-374c9a405c33 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:25.449300 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:22:25.449632 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Mon May 9 23:22:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f (ip 10.222.0.23) !!! May 09 23:22:25.547233 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.policy [None req-ad5138e2-4dbc-46fa-92ca-374c9a405c33 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117142) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:22:25.556877 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-ad5138e2-4dbc-46fa-92ca-374c9a405c33 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1577 microversion: 2.1 time: 0.156953 May 09 23:22:25.557579 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 532/1070] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:22:25 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:22:26.574865 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-a5cec9eb-09b3-49a4-b7fe-96c60425226b tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:22:26.575574 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-a5cec9eb-09b3-49a4-b7fe-96c60425226b tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:22:26.582083 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a5cec9eb-09b3-49a4-b7fe-96c60425226b tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:26.582584 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a5cec9eb-09b3-49a4-b7fe-96c60425226b tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:26.583351 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a5cec9eb-09b3-49a4-b7fe-96c60425226b tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:26.583790 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-a5cec9eb-09b3-49a4-b7fe-96c60425226b tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:26.756912 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-a5cec9eb-09b3-49a4-b7fe-96c60425226b tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:22:26.764763 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-a5cec9eb-09b3-49a4-b7fe-96c60425226b tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1577 microversion: 2.1 time: 0.194083 May 09 23:22:26.765346 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 539/1071] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:22:26 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1577 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:22:27.614068 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [req-58900774-4b5c-4534-bf30-716345d5a5c2 req-51786937-dea2-412b-b877-dd0d83936663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4841e7-e622-4370-9645-e1dcac94d49f", "name": "network-vif-deleted", "tag": "51927c54-b4c2-42df-8816-bce841fa71a5"}]} {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 23:22:27.621918 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-58900774-4b5c-4534-bf30-716345d5a5c2 req-51786937-dea2-412b-b877-dd0d83936663 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:27.622395 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [req-58900774-4b5c-4534-bf30-716345d5a5c2 req-51786937-dea2-412b-b877-dd0d83936663 service nova] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:27.633834 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.compute.server_external_events [req-58900774-4b5c-4534-bf30-716345d5a5c2 req-51786937-dea2-412b-b877-dd0d83936663 service nova] Creating event network-vif-deleted:51927c54-b4c2-42df-8816-bce841fa71a5 for instance 9c4841e7-e622-4370-9645-e1dcac94d49f on hv-cinder-84067 May 09 23:22:27.638712 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [req-58900774-4b5c-4534-bf30-716345d5a5c2 req-51786937-dea2-412b-b877-dd0d83936663 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083300 May 09 23:22:27.639491 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 533/1072] 10.222.0.23 () {64 vars in 1317 bytes} [Mon May 9 23:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 23:22:27.782449 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-e847661c-cbcd-427b-8df6-283c69b77e04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:22:27.783143 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-e847661c-cbcd-427b-8df6-283c69b77e04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:22:27.790754 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e847661c-cbcd-427b-8df6-283c69b77e04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:27.791212 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e847661c-cbcd-427b-8df6-283c69b77e04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:27.791997 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e847661c-cbcd-427b-8df6-283c69b77e04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:27.792436 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-e847661c-cbcd-427b-8df6-283c69b77e04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:27.861764 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.policy [None req-e847661c-cbcd-427b-8df6-283c69b77e04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069d3a8dd790459db3bcfea55f8e19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd557435c4af9467999e66a94c6929e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117143) authorize /opt/stack/nova/nova/policy.py:199}} May 09 23:22:27.869971 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-e847661c-cbcd-427b-8df6-283c69b77e04 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 200 len: 1225 microversion: 2.1 time: 0.092087 May 09 23:22:27.870965 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 540/1073] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:22:27 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 23:22:28.890417 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cdee056c-3265-4284-9a55-b87b1a9b9700 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:22:28.891090 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-cdee056c-3265-4284-9a55-b87b1a9b9700 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 9c4841e7-e622-4370-9645-e1dcac94d49f] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:22:28.897697 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cdee056c-3265-4284-9a55-b87b1a9b9700 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:28.898164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cdee056c-3265-4284-9a55-b87b1a9b9700 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:28.898930 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cdee056c-3265-4284-9a55-b87b1a9b9700 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:28.899371 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-cdee056c-3265-4284-9a55-b87b1a9b9700 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:28.912158 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-cdee056c-3265-4284-9a55-b87b1a9b9700 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] HTTP exception thrown: Instance 9c4841e7-e622-4370-9645-e1dcac94d49f could not be found. May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cdee056c-3265-4284-9a55-b87b1a9b9700 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Request method failure captured: May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f HTTP/1.1 May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieaCoH59VIUV-sqODYiTP511Qxznk7QJ_WtplsVxpf5rqNvJ3YLktf1JIBlZsVvWSinGwffoMgLhyXNvldwDLf_6MizUVxxt3VRUSgJMI9PkczfKNYjcrpx00y0-XnY-A3Co0rk-wOH-k9fVHaGSalER0T3c5_RlHtDMwOkF9uNenFmU May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: d557435c4af9467999e66a94c6929e11 May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-TestVolumeBootPattern-1592477090 May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:22:28.914373 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:22:28.915948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d557435c4af9467999e66a94c6929e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d557435c4af9467999e66a94c6929e11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d557435c4af9467999e66a94c6929e11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d557435c4af9467999e66a94c6929e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:22:28.915948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-TestVolumeBootPattern-1592477090 May 09 23:22:28.915948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: d557435c4af9467999e66a94c6929e11 May 09 23:22:28.915948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-TestVolumeBootPattern-1592477090 May 09 23:22:28.915948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-TestVolumeBootPattern-1592477090-project May 09 23:22:28.915948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:22:28.915948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:22:28.915948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 069d3a8dd790459db3bcfea55f8e19f4 May 09 23:22:28.915948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-TestVolumeBootPattern-1592477090-project May 09 23:22:28.915948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:22:28.915948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 9c4841e7-e622-4370-9645-e1dcac94d49f could not be found. May 09 23:22:28.915948 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '9c4841e7-e622-4370-9645-e1dcac94d49f'} May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4841e7-e622-4370-9645-e1dcac94d49f could not be found. May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:22:28.916825 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4841e7-e622-4370-9645-e1dcac94d49f could not be found. May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4841e7-e622-4370-9645-e1dcac94d49f could not be found. May 09 23:22:28.918302 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:28.919671 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-cdee056c-3265-4284-9a55-b87b1a9b9700 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Returning 404 to user: Instance 9c4841e7-e622-4370-9645-e1dcac94d49f could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:22:28.919671 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-cdee056c-3265-4284-9a55-b87b1a9b9700 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f" status: 404 len: 111 microversion: 2.1 time: 0.030104 May 09 23:22:28.919671 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 534/1074] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:22:28 2022] GET /compute/v2.1/servers/9c4841e7-e622-4370-9645-e1dcac94d49f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:22:29.358593 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b2c837f3-ee04-4621-95ba-2496e9cc4dc2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:22:29.359143 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.compute.api [None req-b2c837f3-ee04-4621-95ba-2496e9cc4dc2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117143) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:22:29.366162 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b2c837f3-ee04-4621-95ba-2496e9cc4dc2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:29.366614 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b2c837f3-ee04-4621-95ba-2496e9cc4dc2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:29.367382 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b2c837f3-ee04-4621-95ba-2496e9cc4dc2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:29.367814 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG oslo_concurrency.lockutils [None req-b2c837f3-ee04-4621-95ba-2496e9cc4dc2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:29.380882 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.wsgi [None req-b2c837f3-ee04-4621-95ba-2496e9cc4dc2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] HTTP exception thrown: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b2c837f3-ee04-4621-95ba-2496e9cc4dc2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Request method failure captured: May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: request: DELETE /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 HTTP/1.1 May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept: application/json May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Accept-Encoding: identity May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Connection: close May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Length: 0 May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Content-Type: application/json May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Host: 10.222.0.23 May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Openstack-System-Scope: None May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: User-Agent: python-urllib3/1.26.9 May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Auth-Token: gAAAAABieaCoH59VIUV-sqODYiTP511Qxznk7QJ_WtplsVxpf5rqNvJ3YLktf1JIBlZsVvWSinGwffoMgLhyXNvldwDLf_6MizUVxxt3VRUSgJMI9PkczfKNYjcrpx00y0-XnY-A3Co0rk-wOH-k9fVHaGSalER0T3c5_RlHtDMwOkF9uNenFmU May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Id: None May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Domain-Name: None May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Identity-Status: Confirmed May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Is-Admin-Project: True May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Id: default May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Domain-Name: Default May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Id: d557435c4af9467999e66a94c6929e11 May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Project-Name: tempest-TestVolumeBootPattern-1592477090 May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Role: reader,member May 09 23:22:29.382663 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Roles: reader,member May 09 23:22:29.384335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d557435c4af9467999e66a94c6929e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d557435c4af9467999e66a94c6929e11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d557435c4af9467999e66a94c6929e11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d557435c4af9467999e66a94c6929e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:22:29.384335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant: tempest-TestVolumeBootPattern-1592477090 May 09 23:22:29.384335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Id: d557435c4af9467999e66a94c6929e11 May 09 23:22:29.384335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-Tenant-Name: tempest-TestVolumeBootPattern-1592477090 May 09 23:22:29.384335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User: tempest-TestVolumeBootPattern-1592477090-project May 09 23:22:29.384335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Id: default May 09 23:22:29.384335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Domain-Name: Default May 09 23:22:29.384335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Id: 069d3a8dd790459db3bcfea55f8e19f4 May 09 23:22:29.384335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: X-User-Name: tempest-TestVolumeBootPattern-1592477090-project May 09 23:22:29.384335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: method: > May 09 23:22:29.384335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: exception: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:22:29.384335 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: action_args: {'id': '91b8028e-96dc-484d-926f-782a423ff712'} May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:22:29.385440 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:22:29.387000 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: ERROR nova.api.openstack.wsgi May 09 23:22:29.388598 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-b2c837f3-ee04-4621-95ba-2496e9cc4dc2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Returning 404 to user: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. {{(pid=117143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:22:29.388598 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-b2c837f3-ee04-4621-95ba-2496e9cc4dc2 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 404 len: 111 microversion: 2.1 time: 0.031813 May 09 23:22:29.388598 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 541/1075] 10.222.0.23 () {58 vars in 1238 bytes} [Mon May 9 23:22:29 2022] DELETE /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:22:29.394613 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d70d14da-d9de-4487-9e54-a2b39493f04d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '>' {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:22:29.394613 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.compute.api [None req-d70d14da-d9de-4487-9e54-a2b39493f04d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] [instance: 91b8028e-96dc-484d-926f-782a423ff712] Fetching instance by UUID {{(pid=117142) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 23:22:29.401170 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d70d14da-d9de-4487-9e54-a2b39493f04d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:29.401623 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d70d14da-d9de-4487-9e54-a2b39493f04d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:29.402415 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d70d14da-d9de-4487-9e54-a2b39493f04d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 23:22:29.402852 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG oslo_concurrency.lockutils [None req-d70d14da-d9de-4487-9e54-a2b39493f04d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Lock "e865ace6-4b09-4716-9268-ae08e665ea6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 23:22:29.416646 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.wsgi [None req-d70d14da-d9de-4487-9e54-a2b39493f04d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] HTTP exception thrown: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d70d14da-d9de-4487-9e54-a2b39493f04d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Request method failure captured: May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: request: GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 HTTP/1.1 May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept: application/json May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Accept-Encoding: identity May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Connection: close May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Length: 0 May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Content-Type: application/json May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Host: 10.222.0.23 May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Openstack-System-Scope: None May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: User-Agent: python-urllib3/1.26.9 May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Auth-Token: gAAAAABieaCoH59VIUV-sqODYiTP511Qxznk7QJ_WtplsVxpf5rqNvJ3YLktf1JIBlZsVvWSinGwffoMgLhyXNvldwDLf_6MizUVxxt3VRUSgJMI9PkczfKNYjcrpx00y0-XnY-A3Co0rk-wOH-k9fVHaGSalER0T3c5_RlHtDMwOkF9uNenFmU May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Id: None May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Domain-Name: None May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Identity-Status: Confirmed May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Is-Admin-Project: True May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Id: default May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Domain-Name: Default May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Id: d557435c4af9467999e66a94c6929e11 May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Project-Name: tempest-TestVolumeBootPattern-1592477090 May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Role: reader,member May 09 23:22:29.418164 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Roles: reader,member May 09 23:22:29.419762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d557435c4af9467999e66a94c6929e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d557435c4af9467999e66a94c6929e11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d557435c4af9467999e66a94c6929e11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d557435c4af9467999e66a94c6929e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] May 09 23:22:29.419762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant: tempest-TestVolumeBootPattern-1592477090 May 09 23:22:29.419762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Id: d557435c4af9467999e66a94c6929e11 May 09 23:22:29.419762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-Tenant-Name: tempest-TestVolumeBootPattern-1592477090 May 09 23:22:29.419762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User: tempest-TestVolumeBootPattern-1592477090-project May 09 23:22:29.419762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Id: default May 09 23:22:29.419762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Domain-Name: Default May 09 23:22:29.419762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Id: 069d3a8dd790459db3bcfea55f8e19f4 May 09 23:22:29.419762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: X-User-Name: tempest-TestVolumeBootPattern-1592477090-project May 09 23:22:29.419762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: method: > May 09 23:22:29.419762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: exception: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:22:29.419762 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: action_args: {'id': '91b8028e-96dc-484d-926f-782a423ff712'} May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: {{(pid=117142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 23:22:29.420765 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. May 09 23:22:29.422015 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: ERROR nova.api.openstack.wsgi May 09 23:22:29.423287 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: DEBUG nova.api.openstack.wsgi [None req-d70d14da-d9de-4487-9e54-a2b39493f04d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Returning 404 to user: Instance 91b8028e-96dc-484d-926f-782a423ff712 could not be found. {{(pid=117142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 23:22:29.423287 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO nova.api.openstack.requestlog [None req-d70d14da-d9de-4487-9e54-a2b39493f04d tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712" status: 404 len: 111 microversion: 2.1 time: 0.030745 May 09 23:22:29.423287 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: [pid: 117142|app: 0|req: 535/1076] 10.222.0.23 () {58 vars in 1235 bytes} [Mon May 9 23:22:29 2022] GET /compute/v2.1/servers/91b8028e-96dc-484d-926f-782a423ff712 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 23:22:29.843475 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: DEBUG nova.api.openstack.wsgi [None req-9bb40932-ddf1-483f-9110-8562dcc62a09 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] Calling method '.version_select at 0x7fc298491d30>' {{(pid=117143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 23:22:29.866769 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO nova.api.openstack.requestlog [None req-9bb40932-ddf1-483f-9110-8562dcc62a09 tempest-TestVolumeBootPattern-1592477090 tempest-TestVolumeBootPattern-1592477090-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-354173559" status: 202 len: 0 microversion: 2.1 time: 0.027182 May 09 23:22:29.867366 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: [pid: 117143|app: 0|req: 542/1077] 10.222.0.23 () {58 vars in 1259 bytes} [Mon May 9 23:22:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-354173559 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 23:24:18.234480 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:24:18.235177 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Mon May 9 23:24:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 23:25:42.973688 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:25:42.974298 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Mon May 9 23:25:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 23:25:45.460156 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:25:45.460794 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Mon May 9 23:25:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 23:27:38.242829 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:27:38.243442 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Mon May 9 23:27:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 23:27:39.074287 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:27:39.074874 dv-cinder-840678-5-iscsi devstack@n-api.service[117142]: Mon May 9 23:27:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 23:27:42.340993 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 23:27:42.341581 dv-cinder-840678-5-iscsi devstack@n-api.service[117143]: Mon May 9 23:27:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!